natos ipe i RE 
Penguin Scienceot lY 
| behaviour 3 


"Assessment in clinical 
psychology 
C. E. Gathercole 


199060090 


m 


M CC 


Penguin Education X14 
Penguin Science of Behaviour 


General Editor: B. M. Foss 


Clinical Psychology 
Editor: Graham A. Foulds 


Assessment in Clinical Psychology - 
` C. E. Gathercole 


Penguin Science of Behaviour 


General Editer: B. M. Foss 


"Professor of Psychology, Bedford College; 


"University of London 


Abnormal Psychology 
Editor: Max Hamilton 


Nuffield Professor of. Psychiatry, 


University of Leeds 


Attention and Set ‘ 
Editor: Graham A. Foulds 
Institute of Experimental 
Psychology, University of 
Oxford 


4 


Clinical Psychology 
Editor: Anne Treisman 
University of Edinburgh 


Developmental Psychology 
- Editor: B. M. Foss 
Professor of Psychology, 

. Bedford | College, - 

V w University. of London 


Method and: History f^. 


Editor: W. M. O'Neil 
cond . Deputy: Vice-Chancellor, 
LIT University c of Sydney 


.. Motivation and Emotion 
Editors: Dalbir r Bindra 
^ Pr essor of Psychology, 4 
‘ McGill’ | University, Montreal 
Jane Stewart 
Associate Professo of. 


Perception and Thinking i 
Editor: P. C. Dodwell ms 
Professor of Psychology; 


Queen's University at : 
Kingston, Ontario 


Physiological Psychology. 
Editor: K. H. Pribram. 
Research Professor of : 
Psychology and Psychiatry, 
Stanford University 


Skills and Learning 
Editors: Harry Kay. 
Professor of Psychology, ii 
University of Sheffield. M A 
L. J. Postman x , oi 


Institute of Human Learnin 
‘University of California, e 


Editor: Michael gyle | 


Mer 


"X 4 £u 


Zo: E 
Assessment in 


Clinical Psychology 


C. E. Gathercole 


ST We 
Libtary 


2 
© 
2 
qa 
D 
= 


erie’ # E 
Calcutta S / 
C. goy JA 


g&o 
[9) 
uy 
x 
2 
To 


Rod 


Penguin Books Ltd, Harmondsworth, 
Middlesex, England 

Penguin Books Inc., 7110 Ambassador Road, 
Baltimore, Md 21207, U.S.A. 

Penguin Books Australia Ltd, Ringwood, 
Victoria, Australia 


First published 1968 
Copyright © C. E. Gathercole, 1968 


Made and printed in Great Britain by 
Hazell Watson & Viney Ltd, 
Aylesbury, Bucks 

Set in Linotype Plantin 


| §.C.ERT., West Benga) 


xs ed AA 
Acc. NOAT. sessao cesses 


This book is sold subject to the conditions that 
it shall not, by way of trade or otherwise, be lent, 
re-sold, hired out, or otherwise circulated without , 
the publisher's prior consent in any form of : 
binding or cover other than that in which it is 
published and without a similar condition. [^ 
including this condition being imposed on. the T 
subsequent purchaser 


Penguin Science of Behaviour 


This book is one of the first in an ambitious project, the 
Penguin Science of Behaviour, which will cover a very 
wide range of psychological inquiry. Many of the short 
‘unit’ texts will be on central teaching topics, while others 
will deal with present theoretical and empirical work 
which the Editors consider to be important new contri- 
butions to psychology. We have kept in mind both the 
teaching divisions of psychology and also the needs of 
psychologists at work. For readers working with children, 
for example, some of the units in the field of Develop- 
mental Psychology will deal with techniques in testing 
children, other units will deal with work on cognitive 
growth. For academic psychologists, there will be units in 
well-established areas such as Learning and Perception, 
but also units which do not fall neatly under any one 
heading, or which are thought of as ‘applied’, but which 
nevertheless are highly relevant to psychology as a whole. 
The project is published in short units for two main 
reasons. Firstly, a large range of short texts at inexpensive 
prices gives the teacher a flexibility in planning his course 
. and recommending texts for it. Secondly, the pace at 
which important new work is published requires the pro- — 
ject to be adaptable. Our plan allows a unit to be revised 
or a fresh unit to be added with maximum speed and 
minimal cost to the reader. 
Above all, for students, the different viewpoints of 
many authors, sometimes overlapping, sometimes in con- 
j tradiction, and the range of topics Editors have selected 
will reveal the complexity and diversity which exist be- 
yond the necessarily conventional headings of an intro- - 
| ( ducory course. 
B.M.F. 
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Editorial Foreword 


'This is the first book to be presented in the Penguin 
i Science of Behaviour project in the field of Clinical 
| Psychology. It offers an over-view of the types of activity 
in which the clinical psychologist engages before turning 
to the rather specific areas of interest constituted by the 
later texts on the various process disorders. The author 
accordingly describes some of the problems with which 
psychiatrists and others present the clinical psychologist. 
These problems include diagnostic assessment, evaluation 
of the effects of treatment, quantification of personality 
characteristics, determination of intellectual level, speed 
and persistence and their appropriateness for a particular . 
a treatment or occupation, and many others. The validity 
^ and reliability of techniques used to acquire data relevant 
to these problems are discussed, as are the methods the 
. clinical psychologist adopts for interpreting and reporting 
on such data, 

Like very many of his colleagues, the author is both a 
research worker and a practising clinician. He shows him- 
self well aware of the desirability of avoiding unneces- 
sary dissociation of the two roles. A gap does, and perhaps z 
always will exist, so that the clinical psychologist has to | 
develop a high tolerance for ambiguity. He has to be 
-prepared to guess, and to make explicit the occasions on 
which he is doing so. The author has tried, and succeeding 
authors in this series will try also, to provide data which 
‘can make these guesses as informed as possible. 

I have hinted that the series is presented under the 
` disorders of process and a few notes on the structure of 
the series may be helpful in this introductory volume. In 
planning a group of books on clinical psychology, the 
main choice with which one is presented is between 
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grouping by diagnosis or by process. Probably the majority 
of clinical psychologists believe that the classification of 
psychiatric illnesses is neither sufficiently reliable nor 
sufficiently free from arbitrariness to serve our purpose, 
When, however, one tries to group in terms of processes — - ; 
attending, remembering, perceiving, thinking and so forth 
— it immediately becomes apparent that these distinctions 
are no less unreliable or arbitrary. If one opts for diag- 
nostic grouping, processes of no known striking relevance. 
to a particular illness may tend to be neglected; if one op 
for process grouping, illnesses of no known striking rel 


one AES than the other, it was decided to | "ed 

'The primary grouping is in terms of disorders of. js 
cesses, the normal functioning of which will often | 
treated more fully in books in other fields of this Pengui 
Science of Behaviour project. There will, accordingly, 


one and takes place inside each book. Here it is ho ) 
that at least the main diagnostic classes will be adh ed. 
and the organic psychoses. Any reader who wish | tO 
learn what clinical psychologists have to say, : for € 
about the neuroses will be able, as it were, to tu 
classification upside down and to work through thi 


EA 
texts within the framework : the neuroses — disorders. 
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attention, disorders of learning and memory, etc. When 
there is little or nothing to say under any particular head- 
ing, authors will point this out so that the reader will be 
able to rest assured that the area has not been overlooked. 

A subsidiary mode of classification within the primary 
mode will often be: identification, assessment and measure- 
ment of the disordered process; conditions under which 


the process disorder may arise; conditions under which . 


it may be modified and conditions under which it might 
be prevented from arising. 

Clinical psychology, which is virtually a post-war de- 
velopment, has been most closely associated with psy- 
chiatry. As Mr Gathercole points out, one expects rapid 
change in such a new discipline and he discusses the 
opportunities presented by automation and increasing 
computer facilities. Another development may well be in 
the direction of increasing contact with other medical 
specialities and with sociology, and it will be surprising, 

f, in the next decade, there is not much to report in 
these and other areas. 


G.A.F.- 


Preface 


The aim of this book is to provide an introduction and a 
framework to some of the main issues of assessment. 
There are three kinds of student for which the book, 
though it makes no claims to be comprehensive, may be 
useful. First, undergraduate psychology students may 
find it a useful adjunct to courses in personality assess- 
ment. Next, for psychiatrists in training, it offers an 
outline of the approaches to assessment used by psycholo- — 
gists. Effective mutual collaboration between psycholo- - 
gists and psychiatrists can only be improved as 
psychiatrists increase their understanding of these ap- 
proaches. Finally, and most directly, to the postgraduate 
student of clinical psychology who needs to orientate 
himself to the problems he will face in the practice of 
assessment, 

The bulk of the work of clinical psychologists con- 
‘tinues to be done in conjunction with psychiatrists, X 
although a growing number are working in various other 
settings, such as in consultation with other medical 
specialists in general hospitals and with general practi- - 
b tioners and in private practice. This book is concerned v 

— with the context of adult psychiatry so the special prob- 
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e studer in his first contact with clinical psycholo 
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and for which little guidance is available in the larger 
textbooks. Where theoretical and conceptual issues are 
discussed the intention is to alert the student to topics he 
will encounter in more advanced reading. 

In such a new field as clinical psychology one expects to 
find variations in outlook and practice. One also expects 
to find rapid change and development in various direc- 
tions. I have attempted to present this variety without - Y 
being too partisan. 

I am indebted to the many psychologists and psychia- 
trists who have contributed to this book by their sympa- 
thetic and constructive discussions. Thanks are due to 


Gathercole for his editorial work. 


f 1 Introduction 


The Need for Psychological Tests 


'The purpose of assessing a psychiatric patient is to pro- 
vide information on which decisions about his future can 
be based. What treatment should he have? Should he be 
taken into hospital? Should he be discharged? Should he 
be persuaded not to take up his former employment? 
Should he have further investigations? These are some of 
the practical day-to-day decisions a psychiatrist has to 
make. X 
. In order to make these decisions he requires informa- 
tion about the patient, some of which he will gather from — 
_ his examination of the patient's mental state. He evaluates i a 
his findings in the light of the patient's history, family — 
history and his physical condition and then formulates a ) 
tentative opinion. Often further information will be re ; 
quired from various sources so that a more precise 
reformulation can be made. Then decisions regarding the 
Xi WA . patient's treatment and disposal will be made. Such de- 
sions involve prediction. For instance a patient with — 
matic complaints resulting from tension is believed. to M 
I numerous problems which he avoids facing. dt 
predicted that if he is confronted with his problems. ‘an d. 
anages to sort them out his tension and Nes 
mati ‘complaints also will be reduced. p 


o him for significant features which will HS 
unt for the patient’ 8 symptoms. He considers 
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are relatively crude and insensitive so that only the grosser 
forms of deficit and disorder will be caught in the net (see 
the discussion on bandwidth and fidelity, chapter 5). In 
addition, these procedures are very subjective, In one 
study, a correlation of only 0-25 was found between ex- 
perienced psychiatrists rating anxiety in 80 psychiatric 
patients (Cattell, 1957). Often inferences about the patient 
are made which are greatly influenced by irrelevancies. 
The impressive appearance or cultured accent of a patient 
may influence a judgement about his intelligence. 'The 
personality of the psychiatrist may influence his con- 
clusions regarding patients through counter-transference 
and projection. One psychiatrist sees hostility in the eyes 
of every patient whereas another cannot see hostility at 
all. ` 

The need for developing psychological techniques to 
assess the behaviour of psychiatric patients has long been 
recognized by psychiatrists. Kraepelin studied with 
Wundt and used tests of memory, fatigue and learning 
ability in his psychiatric research. Jung experimented with 
word association tests and the galvanic skin response 
(G.S.R.). (See Appendix 1 for notes on tests.) Kretschmer 
made considerable use of psychological tests in his psy- 
chiatric research, Y 

It is interesting that a number of tests which are now - 
used mainly by clinical psychologists were introduced by 
psychiatrists: for example Rorschach's inkblots (1942) | 
and Lauretta Bender's Visual Motor Gestalt Test (1938). 
Several tests have resulted from collaboration between | 
psychiatrists and psychologists: for example the Minne- 
sota Multiphasic Personality Inventory (M.M.P.L) 
(Hathaway and McKinley, 1951), Progressive Matrices 
(Penrose and Raven, 1937), Tests of Abstract and Con- 
crete Thinking (Goldstein and Scheerer, 1941), Family 
Relations Indicator (Howells and Lickorish, 1962). AL 
though psychiatrists often employ psychological tests | 
themselves, particularly in the examination of organic. 
patients (Klein and Mayer-Gross, 1957), testing has come 
to be regarded mainly as the province of eum 


E 


19 Objectivity 


This is probably because research into tests has been done 
, mainly by psychologists who have thereby acquired ex- 
^ pertise in test development. 

The training of the psychiatrist is centred on abnormal 
behaviour but the psychologist's training covers the whole 
range of behaviour so that he sees abnormal behaviour as 
deviation from the normal. Whether he is using tests and 
specialized assessment techniques or not the psychologist — . 
provides a quite different contribution to the understand- 
ing of psychiatric patients from the psychiatrist by reason 
of his totally different training background. 

The psychiatrist, having formed a tentative opinion 
about a patient, frequently needs more information about 
certain features of the patient's behaviour. He is aware 
that he requires more reliable, more Objective, and less 
crude techniques for assessment in order to provide a 
better basis for decisions and therefore more effective pre- 
diction. 

The psychologist, being somewhat more aware of the 
. need for objectivity and measurement in the description — 
. and explanation of behaviour, provides a valuable contri- . 
bution to decision making through the techniques he has 
_ for just such improved assessment. In addition, psycholo- 
1 gical tests provide an opportunity for sampling a wider 
i variety of behaviour than is possible in an interview. Thus — 
they often extend the range of information about the y 
patient. Indeed the clinical psychologist's assessment of 
b: psychiatric patients is best seen as an extension of the — 
— examination undertaken by the psychiatrist. ` 


"Objectivity 


tivity in studying perception. His three main criteria fa 
"objectivity can be applied in the field of psychiatry. All 
" E three criteria are closely related. If they are all satisfied the 
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The first criterion is whether observer involvement is 
reduced to a minimum. Bias can creep in at the level of 
behavioural description. One aim in using psychological 
tests is to provide a situation in which the eliciting and 
recording of behaviour is as independent of the tester as 
possible. This is arranged by having standard situations 
in which patients are given standard instructions and 
by having testers trained to administer tests in a stan- 
dard way. In addition, rules for scoring are applied 
consistently as laid down in test manuals, Where these pro- 
cedures are followed there is less distortion in the descrip- 
tion of the patient's behaviour due to the observer. - 
"Unfortunately, observer bias can also creep in at the level 
of interpretation of observations. This is because the - 
experience of each individual observer is biased and any 
subjective interpretation he may make will be based on 
this unrepresentative sample of experience. Tests over- i 
come this limitation. They can be administered to repre- 
sentative samples of the population and the data resulting 
from this standardization can be used to interpret the 
Score of the individual patient. Norms are-provided in the — 
test manuals to facilitate interpretation and in this way 
_the observer is eliminated as a source of bias at the level of — 
interpretation. J 

The second criterion of objectivity is whether the con- 4 
tact between the observer and the observed behaviour is. 
increased as far as possible. Tests are generally devised SO 
that a performance or a response is elicited which. can be 
recorded for subsequent scrutiny. For example in the 
Porteus Maze Test of foresight and planning the subject 
is required to show the way out of mazes which are 
drawn on paper. By using a pencil to do this he leaves E 
hind him a permanent record of his errors and successes. 
The recording of test responses is intended to improve 
observer contact or what Allport calls ‘denotation’. 

'The third criterion is whether the operations defining f 
the situation. in which the Observations are made, are 
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different observers are to agree about what they observe. 
The use of test manuals describing the procedures re- 
quired and instructions to be given, as well as the training 
of testers, all serve to improve Observer agreement and 
repeatability of results. 

It has to be acknowledged that much psychological test- 
ing-is no more objective than the psychiatric examination. 
Projective tests, for example, cannot be claimed to have 
any advantage in objectivity, though they may still be 
useful for other reasons. 

Unfortunately the term objective is often applied loose- 
ly to psychological tests. In using it authors do not always 
state clearly whether they are referring to the response 
elicited. from the subject, the scoring applied to the re- 
sponses, or the inferences drawn from the responses. 

A response made in a questionnaire is a self-evaluation 
based on introspection and is therefore subjective. The 
response to perceptual tests such as the Archimedes spiral 
is a verbal report concerning a perceptual experience and 
is therefore subjective. A Rorschach response is also a 
verbal report on a perceptual experience and therefore 
subjective. But a G.S.R. or speed of tapping includes 
neither self-evaluation nor verbal report and is objective. 

Scoring of test responses may involve a subjective 
judgement on the part of the scorer. This is usually the 
case with open-ended tests in which the subject is pro- 
vided with an opportunity of responding in a great 
variety of ways, Thus the Rorschach is an open-ended 
test and the scorer has to attempt to classify the subject’s 
responses. A closed test in which the subject is severely 
restricted in the responses he may make, as in multiple 
choice tests, requires no judgement by the scorer. A ques- 
tionnaire that requires ‘yes’ or ‘no’ for an answer to each 
question can be quite objectively scored with no element 
of subjectivity involved. Wherever there is room for 
judgement in scoring there is the chance that different 
scorers will disagree. Where judgement by the scorer is 
eliminated then scoring will be the same whoever does it. 
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Conclusions as to what the responses mean may be 
made on the basis of clinical judgement. The clinician 
evaluates a Rorschach protocol so that his inferences are 
subjective. Where inferences are drawn by actuarial means 
no judgement is involved and therefore no disagreement 
arises between observers trained to draw inferences actu 
arially from the scores given by a subject. Such inference 
is therefore objective (see chapter 3). Both subjective - 
and objective methods of inference may be applied to 
responses which may be subjective or objective and 
which have been scored by either subjective or objective 
means. 

Cattell’s use of the term objective is rather idiosyn- 
cratic. He uses it ‘to distinguish from questionnaires those 
tests in which the individual actually acts ... and has his iy: 
performance measured without being aware what traits | 
are being measured’ (1965, p. 372). Cattell classifies as. 
objective projective tests such as the Thematic Appercep- 
tion Test (T.A.T.) and Rorschach as well as laboratory 
techniques such as motor coordination, body-sway sugges- _ 
tibility, and G.S.R. Questionnaires he classifies as subjec- 
tive because the subject is evaluating himself, 

The same test may be described as objective by one 
writer and not objective by another. They are not neces- 
sarily disagreeing. They are probably referring to different 
aspects of the test. This variation in usage of the term 
however does cause some confusion. Ux ] 

It is clear that psychological tests are used in an effort 
to increase objectivity in assessment. Although perfect 
objectivity is never achieved, it can be said by reference to 
the three criteria mentioned above that one procedure is- 
more objective, and therefore a better basis for prediction, 
than another. j 


Measurement ] 
1 


» 
The importance of measurement in psychiatry has been 
emphasized by Mayer-Gross, Slater and Roth (1960). A 
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In medicine we have to deal with causes of all kinds, and not 

only those that are both necessary and sufficient. In searching 

; for a cause of some phenomenon, we are really searching for 

n. a quantitative relationship .. . We can, if we like, lose our way 

` in a causal network: but we need not do so if we take into 
account the quantitative aspect of causation. It is at this point 

` that so much psychiatric thought loses cogency and direction. 
Quantitatively important causes are tangled in a knot of others 
whose quantitative relation with the effect we are interested in 
is slight or entirely unknown (p. 6). 


It is often claimed that such intangibles as feelings can- 
not be measured. But where terms such as ‘more than’ 
and ‘less than’ are used in description then some degree or 
amount of the quality described is implied. People can be 
ranked in order of the degree to which they possess some 
quality even though it is not possible to say exactly how 
much more of the quality one person has than another. 
"This level of measurement is known as ordinal scaling 
© (Stevens, 1951). It is not as exact as interval scaling in 
which the distance between the numbers is known; as in 
u the centigrade scale the difference between a temperature ] 
In E 10°C and 20°C is the same as between 80°C and 90°C. - 
By devices such as scale transformations a semblance of an | t 
interval scale may be achieved in psychology but this M i 
should not persuade anyone that the measurement of be 
haviour Beprodches: the level of measurement in physi 


È, 
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T3 E create a e Eod if ien impression. 
D _ Nevertheless, an attempt at measurement on ordinal scales. 
9 1s better than no attempt at all. Indeed a great deal can. M 
be a lieved vain ordinal measurement despis its ine 
tions. (a 
Y Mes surement is an aid to objectivity. Norms based ne 
cores 1 plied to test responses help the ps sychologist to 
dual p: jent's test 
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formance independently of the psychologist's own back- 
ground and experience. 

There are dangers in applying scores to behaviour. One 
is that information which is difficult to score or manipu- 
late statistically may be discarded. This may result in a 
serious loss of data. Another danger is that the test con- 
structor and user may become obsessed with figures so 
that he loses sight of their psychological meaningfulness. 
As G. W. Allport (1961) observes: 


Basic methods of quantification are indispensable for deter- | 
mining the reliability and validity of methods. Our only criti- 

cism Of quantification comes when it is made the primary - 
objective in research and theory rather than a tool’. . . Statistics 
is a useful adjunct but the field of personality should not be — 
a mere playground for the mathematically gifted (p. 459). 


Clinical Psychology as Applied Science 


One of the principal tasks of clinical psychologists is to 
extend the use of measuring devices in psychiatry. The 
clinical psychologist who is in touch with the research ^ 
literature is in a position to recognize ways in which 
techniques, hitherto used in research only, may be applied 
to clinical problems. In this way research developments 
are made available to psychiatry. And undoubtedly psy- 
chology has a great deal to offer psychiatry. 
One measure of the value of any science is in its. ap- ! 
plicability. Although the potential application in psychia- 
try is great, it is only slowly that the relevance of the 
concepts, principles and theories of psychology has be- 
come appreciated. It is largely due to clinical psychologists | 
that the findings of psychology in such fields as learning, 
memory, sensation, perception, thinking, motivatio 
attitudes, interests, social psychology and physiolo; 
psychology are being applied at all. The clinical psycholo- 
gist is first and foremost a psychologist, consequently he | 
will be useful in so far as he is able to relate his knowledge. 
of uu caf to the practical problems of psychiatry. ] 
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This information traffic does not flow in just one direc- 
tion. The opportunity of studying the abnormalities of 
behaviour has benefited psychology. Much of what is 
known about personality structure and function has been 
gained from psychiatric patients and many psychological 
theories have been born or nurtured in the psychiatric 
clinic. 

The clinical psychologist is both applied scientist and 
pure scientist. The distinction between applied and pure 
science is difficult to maintain in the older natural sci- 
ences. It is impossible to maintain in the fast developing 
behavioural sciences. The investigation of practical prob- 
lems frequently produces valuable ‘pure’ knowledge. 
Although the knowledge thus gained has practical impli- 
cations it is as pure as any generated in the laboratory. 


Tolerance of Uncertainty 


Considering the complexity of the subject matter, the 
achievements of psychiatry and psychology are a source of 
pride and encouragement to those working in these fields. 
Nevertheless the fact has to be faced that both psychiatry 
as a branch of medicine, and psychology as a branch of 
science are still at relatively early stages of development. 
There is much research to be done in these fields. Without 
the benefit of that research there will be much uncertainty 
in clinical practice. 

The clinical psychologist has to develop the capacity to 
tolerate uncertainty if he is to continue to work in the 
clinic. This is not to be taken as a recommendation that 
he should be satisfied with this uncertain state of affairs. 
Nevertheless in clinical work it must be acknowledged 
that much of the time one has to live with uncertainty. 
Psychologists at times have to make judgements ‘on 
the basis of inadequate data. Time and other economic 
factors are of considerable importance in Clinical work, 
and decisions of importance may have to be made when 
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hypotheses are untested or partially tested’ (Jones, 1960, 
p. 780). It is 

legitimate to decide to work on the basis of a certain assump- 
tion with a patient because the patients condition urgently 
demands action and the psychologist or psychiatrist knowingly 
takes a step into the dark, There are relative degrees of cer- 
tainty with which one can entertain theories about a patient's 
condition and what can be done about it ... the applied 
scientist has often to plunge into guesswork and trial and 
error ... (Shapiro, 1951, p. 760). 

One of the reasons for uncertainty is that the technical 
aspects of tests (standardization, norms, reliability and 
validity) are rarely as adequate as might be hoped for. In © 
addition, information about the population to which the - 
tests are being applied (base rates, see chapter 6) is rarely: 
available, Sometimes it is possible to estimate the margin 
of error associated with a test result but often this is not 
possible. | 

Despite these deficiencies the psychologist is often the 
best equipped person to assess certain aspects of patients' 
behaviour and he should not avoid making his contribu- 
tion. As Piercy (1959) points out, if he declines the task — 
it will be undertaken by someone else, using even more | 
inadequate data. The estimates or predictions made by the 
psychologist are not free from error. Yet they are often the 
best informed estimates so that the margin of error will b 
less than is contained in the estimates of others. 

The recommendation of a rigorous scientific approacl 
in clinical psychology whilst laudable i in its aim often. hi 


chologist does not have the same kind of experience. 
When he enters clinical psychology he is liable to be con: 
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many decisions are based. These doubts may be so 
crippling that he can make no decision at all. Such a per- 
son would probably find projective techniques unpalatable 
and even the limitations of more objective, simpler, better 
validated tests might generate too much anxiety. These 
doubts are often particularly severe in the psychologist 
who has entered the clinical field with a crusading spirit, 
to free psychiatrists from the dangers of their own sub- 
jectivity. He is liable to become disenchanted when he 
finds that it is often difficult to assess the validity of tests, 
particularly where construct validity is concerned. Even 
when correlation coefficients are available they are gener- 
ally rather low: of the order of 0:20 to 0-60. It is impor- 
tant to point out, as Cronbach (1961) does, that although 
the validity of a test may not be as great as one might 
wish, the test will be useful as long as its validity is greater 
than that of other methods used for the same purpose. 
Cronbach and Gleser (1965) argue that ‘A test of validity 
0-20 in one situation may be more beneficial than a test of 
0-60 in another. The characteristics of the specific decision 
determine “What the test is worth”. 

Another reaction to this dilemma of having to make 
judgements on the basis of inadequate data is for the psy- 
chologist to minimize the inadequacies. In this case the 
psychologist denies the uncertainty and acquires a con- 
fidence in his judgements which may be quite un- 
warranted. 

Apart from the technical shortcomings of tests there 
are uncertainties about theories and orientations in both 
psychology and psychiatry. Desai (1965) points out, 


In the field of personality we have widely divergent approaches, 
with antitheses between the nomothetic and the idiographic, 
the atomistic and the gestalt, the molecular and the molar. We 
have approaches which believe in marked emphases, to say 
the least, on one or more of the various aspects of personality; 
for instance, in terms of broad categories, on the mask or the 
structure aspects of personality, or more specifically, on overt 
behaviour, traits, hierarchy, integration, dynamism, adjust- 
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ment, or uniqueness as the essence of personality, There are 
approaches to personality which reject, out of hand, any re- 
ference to unconscious motives and dynamics while others lay 
extreme emphasis on unconscious motives and conflicts and 
minimize the importance of conscious motives, We have 
beliefs which stress the importance of the independence of 
contemporaneous motives from their sources of origin. On the 
other hand, we have emphasis on instinctual urges and early 
unconscious motives which are believed to continue to in- 
fluence our apparently most contemporaneous and varied 
modes of experience and behaviour, ! 

If we bear these facts in mind it becomes obvious that what 
problems a clinical psychologist poses himself, the way he 
approaches them, the methods he uses to answer them, the 
practical inferences he draws from his findings and the sort 
of predictions he makes, would depend on the clinical psycho- 
logist's own frames of reference, his orientations, attitudes and — | 
beliefs in relation to general psychology, clinical psychology, | 
Psychiatry and more specifically on the views of personality 
he explicity or implicitly holds (p. 2). 

Whilst recognizing the shortcomings and limitations of | 
assessment procedures as well as the theoretical contro- | 
versies in the field of personality, it is the view of this 
writer that enough is known concerning assessment for 
clinical psychologists to make a valuable, independent, 
and unique contribution to psychiatric problems. y 


2 Assessment Referrals 


Introduction 


It is an astonishing fact that there is virtually no discus- 
sion in the literature of the kind of referral problems to 
which psychologists have a contribution to make. One 
would expect to find in books describing tests used in 
clinical psychology some mention of what they might be 
used for. But this is rarely the case. 

Since clinical psychologists work mainly in conjunction 
with psychiatrists it is important that psychiatrists should 
be informed as to what problems are most profitably sub- 
mitted to psychological investigation. Obviously if psy- 
chiatrists do not ask the right kinds of questions they do 
not get the answers they need from psychologists. The 
aim of this chapter is to present briefly the main areas of 
assessment problems. Before doing this however it will be 
useful to take a look at the general context within which 
referrals to the psychologist are made. 


Factors affecting referral questions 


First, referral problems will vary according to the type of 
setting in which the psychologist finds himself because of 
differences in psychiatric decisions required. In out- 
patient units and admission wards the emphasis is on 
turnover of numbers, early diagnosis and quick disposal. 
Since diagnosis in the early stages of mental illness is 
often uncertain and the effectiveness of treatment is nearly 
always greatest in the early stages there tend to be a large 
number of diagnostic problems referred to the psycholo- 
gists in such units. Where there is less concern about rate 
of turnover psychiatrists are more prepared to ‘wait and 
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see’ when diagnosis is uncertain. Most psychiatric condi- 
tions will declare themselves one way or the other eventu- 
ally and a psychologist working in a unit with this sort of 
approach may get fewer requests for aid in establishing 
diagnosis and perhaps more for treatment and assessment 
of treatment outcome. 

Second, the orientation of the referent will influence 
the kinds of problems he refers. If he is keen to initiate 
psychotherapy he may ask for elucidation of conflicts, - 
psychosexual development and the patient's typical de- 
fence mechanisms. If he is interested in neurological 
aspects of psychiatry he may be on the look-out for cogni- 
tive impairment resulting from brain damage so that his 
referral questions will be different. 

"Third, the psychologist's own interests will determine 
the sort of problems he encourages his colleagues to refer. 
He may be interested in global personality assessment | 
using projective techniques, or he may be more concerned — 
with the Study of specific mechanisms and use strictly i 
objective ‘procedures, The sort of problems referred to i 
him will also partly depend on how far he has managed tome 
persuade his colleagues of the value of his particular aN 
approach to assessment. 

Lastly, referral questions will depend on the assessmen! 
techniques available. There are continual developments. in 
this field. Modifications of existing techniques (Kornri 
1965), novel applications of traditional techniques (Payne , 
and Friedlander, 1962) and creation of new procedures V 
(Foulds, 1962) all have to be kept under review and d 
out. When a psychologist is convinced that a research de- : 
velopment has clinical application it is for him to dem 
strate its utility to his colleagues and persuade them o 
value. 


Problems associated with referral — 
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sidered decision made in full awareness of the dangers 
involved. 

Junior psychiatrists often have clinical problems which 
should be discussed with their consultants but which in- 
stead get referred to the psychologist. This may happen 
where channels of communication between consultant and 5 
junior are poor or supervision is inadequate. 

Where the psychiatrist’s case load is very heavy he may 
unload some of the problems he would otherwise handle 
himself on to the psychologist. This may not in itself be a- 
bad thing because there is in fact a great deal of overlap 
of functions. Some kind of division of labour has to fol- 
low if each is to work most effectively. The actual divi- 
sion that takes place can be regarded as an administrative 
problem of staffing but the psychologist should consider 
carefully the implications of taking on the role of 
non-medical psychiatrist thrust upon him by such 
exigencies. 

Indiscriminate referrals can be made for the purpose of » 
case conferences. The doctor presenting the case asks for 
psychological assessment for the sake of completeness and 
in anticipation of questions which may be raised in the 
discussion of the case. Such referrals may have educational 
value and can be used by the psychologist as opportunities 
for showing his colleagues the sort of problems he wishes 
to have referred. 

Indiscriminate referring of patients to psychologists can 
occur in units where medical laboratory services are 
readily available and doctors may get into the habit of 
referring patients routinely for various laboratory tests. 
This attitude can be generalized to the psychologist with 
the danger that the more automatic the habit of referring [ 
the more vague is the problem referred. 

Inadequate discussion between psychiatrist and psycho- 
logist can often produce difficulties. Sometimes a psycho- 
logist may reformulate a referral problem or he may 
unearth a problem during his investigations which he 
feels is worth further elucidation. For example, a phobic 
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woman is referred for assessment of intellectual level in 
relation to the demands of her job. The question is  . 
whether the stress of her work has to be considered as a 

factor contributing to her neurotic state. The psychologist | 
to whom the patient is referred is more interested in other 
aspects of the case and by means of projective tests he 
discovers sexual difficulties which he identifies as the 
determining factor in her phobia. This may be something 
the psychiatrist knows already or something he does not | 
wish to confront the patient with anyway. In such cases. 
discussion with the psychiatrist is essential if the psycho- 
logist’s contribution is to be clinically relevant. Of course 
the psychologist does not withhold some observation or 
finding merely because the psychiatrist did not ask for it. 
A symptom such as an intermittent Parkinsonian tremor 
may occur during interview with the psychologist which — : 


warranted omission if he failed to mention this in his 
report. ` 
Referrals can be phrased in such a way that the opinion 
of the referent is plainly stated: for example, ‘Would yo 
confirm my impression of defective intelligence?’ T] 
Psychiatrist in formulating the referral in this way 1 
clearly seeking support for his own opinion rather than H 
an impartial assessment. He runs the danger of encouraging — 
the psychologist (particularly the inexperienced one) to j 
tell him what he wants to know rather than what he 
should know. This danger becomes important when tht 
psychologist departs from findings derived from the appli- 
cation of properly validated, objective, standardized tests 
and begins to use clinical judgement and acumen in orde 
to give an opinion rather than a finding. He then runs the 
risk of his judgement being influenced by the way in 
which the referral was made. Because there are few est: 
which are acceptable technically — particularly in the 
assessment of personality — this risk tends to be a iu 
occupational hazard. There is less danger if the psycholo- - 
gist’s report clearly states which conclusions a: o jective | 
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findings, which are subjective inferences from the test data 
and which are opinions less firmly based on evidence. 

A further danger the psychologist faces is that he may 
get swamped with referrals so that he may feel he has to 
sacrifice any research he may wish to do. However valuable 
the contribution he makes to clinical problems it is essen- 
tial that he devote time to reviewing developments in 
assessment techniques and contributing to those develop- 
ments. This is necessary if the contribution which psycho- 
logy has to make to psychiatry is to be fulfilled. 


The following discussion indicates some of the ways in 
which psychological assessment can be useful in work 
with adult psychiatric patients. No attempt is made to 
discuss systematically all the referrals which may arise in 
work with children and in other psychiatric sub-special- 
ties. 


Cognitive Deficits 


Among the cognitive functions which are frequently im- 
paired in psychiatric conditions are reasoning, learning, 
memory, mental and motor speed and perceptual-motor 
coordination. Adequate description of a patient’s level of 
functioning in these areas is often very useful in answering 
a number of questions which are asked about patients. 


Organic or functional? 


This is a differential diagnosis frequently in the mind of 
the psychiatrist and it is a problem on which the psycho- 
logist can usually provide valuable evidence. The distinc- 
tion between depression and dementia in old age; the 
exclusion of an organic condition in a depressed patient 
being considered for E.C.T.; the relative severity of organic 
and functional impairment in a patient with a known 
organic condition exhibiting some hysterical behaviour; 
Ganser symptoms requiring identification as manifesta- 
tions of a schizophrenic, hysterical or organic condition; 
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the establishment of organic causes in a patient com- 
plaining of memory loss or giving evidence of confabula- 
tion: these are some examples of such problems. 


Suspected organic involvement 


Frequently organic involvement of the central nervous 
system is suspected on the basis of clinical evidence. For 
instance, change of personality in an elderly person show- 
ing loss of social graces and inability to curb aggressive 
impulses may suggest an organic disease. Unusual word 
usage may suggest dysphasia. A history of head injury, 
alcoholism or fits in a patient may arouse suspicion of 
deterioration. Detailed investigation of such patients with 
suspected deterioration will be advisable and the results 
may indicate the need for further physical investigations. 


Baseline for serial assessment - 


Because it is sometimes desired to follow the changes in a 
patient's mental state over a period of time, repeated 
assessment may be requested. This is particularly useful in 
cases of suspected deterioration. Where later testing can 
be related to earlier performance, changes are more easily 
detected. The effects of treatment can be followed in this 
way too. For instance, where a vitamin deficiency is sus- 
pected as the cause of cognitive impairment this can be 
checked if treatment for the deficiency is accompanied by | 
assessment before and after treatment. ( 


Residual impairment after treatment 


When symptomatic recovery appears clinically to have 
gone as far as it will after withdrawal of alcohol, arrest Of — 
.G.P.I. (general paralysis of the insane), leucotomy, myxoe- — 
dema or carbon monoxide poisoning for instance, there is 
usually the question as to whether there is any residu 
deficit and if so how extensive it is. 


Localization 
Despite the contradictory findings of localization stuc 
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The Use of the Intelligence Quotient 
(Meyer, 1960) psychological tests can often be of use in 
providing a description of behaviour for the purpose of 
relating psychological deficits to specific areas of brain 


damage. 


The Use of the Intelligence Quotient 


Intelligence is a dimension of personality that has to be 
estimated in every case a psychiatrist sees if his clinical 
formulation of the patient's condition is to be adequate. 
One of the first judgements he will make concerns the 
patient's level of understanding and expression so that he 
can adjust his questions and the form of the interview 
accordingly. During his training the psychiatrist learns to 
assess intellectual level on the basis of the patient's school 
record, work record, current general knowledge and vo- 
cabulary usage. It is only when the psychiatrist cannot do 
this himself or has doubts about his clinical impression that 
he should refer a patient to the psychologist if it is impor- 
tant to have an accurate indication of the intellectual 
level of functioning. Such difficulties or doubts commonly 
arise with the older working class patient whose educa- 
tional opportunities were poor, in distinguishing within 
the I.Q. range 75-95 between the categories low average, 
dullard and borderline defective and with dysphasic 
patients, deaf mutes or any patients with whom verbal 
communication is difficult. Suitability for verbal forms of 
psychotherapy is often partly decided on the basis of 
intellectual level, so that when there is difficulty in en- 
couraging an inhibited patient to speak during the 
initial clinical assessment, referral for testing may be in- 
dicated. 

Educational subnormality is often suspected by a psy- 
chiatrist and he may require a more accurate assessment 
of level of functioning than he can make clinically. Some- 
times this may be one of a number of possibilities in his 
mind. The distinctions between amentia, dementia and 
simple schizophrenia, for instance, are often not easy to 
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make clinically and testing may narrow down the possibi- 
lities. 

Court cases are often referred for assessment of intellec- 
tual level particularly where a low level is suspected and - 
the question arises of the patient's understanding of right 
and wrong actions. 

There are intelligence tests which psychiatrists can 
administer themselves. These are mainly tests devised pri- 
marily for group testing and are therefore largely self- 
administering such as Raven's Progressive Matrices and — - 
the Mill Hill Vocabulary (Raven, 1958b, 1960). The danger 
with tests which are easy to administer is that interpreta- 
tion may be mistakenly thought to be equally easy. Unless 
a psychiatrist has been adequately trained in the use of the 
test therefore he is well advised to leave the interpretation 
to a psychologist. 

'The psychologist needs some indication of intellectual 
level in nearly every case. He may need it in order to de- 
cide what tests to give. For example some questionnaires 
are of little value for patients of below average intelligence | 
because of their difficulty in working out the double nega- 
tives involved as in the following item: ‘I cannot concen- 
trate my mind on one thing.’ If you answer ‘false’ for this — 
you are denying the first negative, which requires an 
average degree of intelligence to comprehend. z E 

It is important to know the intellectual level in order to — 
interpret results on many tests. A patient’s answers to — 
proverbs which are above his intellectual capacity and 
therefore ones which he could not be expected to get | 
right, would be impossible to evaluate without an TOME 
estimate. Many such tests as the Memory for Designs. 
Test indeed require an I.Q. component, such as vocabu- 
lary score, for calculating results. í 


Classifying and Explaining Abnormalities of Behaviour 
ENAR CU 

In the previous sections on cognitive deficits and assess- 

ment of intellectual level the contribution of. psycholo- 


n 
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gical assessment is obvious, and the problems involved are 
fairly clearly understood. Development is merely a matter 
of refining techniques. 

In the field of the functional and personality disorders 
psychological assessment is much more controversial. 'This 
is partly the result of the controversies within clinical 
psychiatry and partly the result of inadequate techniques 
available in clinical psychology. 


Diagnosis 

A primary task of the psychiatrist is to classify the patient 
and put a label or a diagnosis on him. This is often diffi- 
cult to do with certainty and so the psychologist is often 
asked to help in the differential diagnosis of patients. 
One way in which psychologists have attempted to answer 
referral questions of this sort is by using tests which 
have been given to groups of patients having the diagnoses 
in question. Thus Meehl and Dahlstrom (1960) used the 
M.M.P.I. to differentiate neurotics and psychotics. Payne 
(1958) has argued that this usage of psychological tests 
contributes little of value to psychiatric practice. He 
points out that a diagnosis has a number of implications. 

First it implies a description. A diagnosis is used as a 
kind of shorthand for referring to a cluster of symptoms. 
Unfortunately one cannot tell from the diagnosis which 
symptoms are present nor how severe is the condition. A 
test validated against the diagnosis ‘psychotic depression’. 
therefore could not give any more adequate description 
than is implied in that diagnosis. Payne suggests that the 
descriptive significance of a diagnostic test score is nil 
because it adds nothing to the descriptive information of 
the psychiatrist. 

The second implication is for prognosis. Unfortunately 
few psychological tests are validated against the future 
course of the illness so that for most tests the prognostic 
implications are unknown. 

The third implication of the diagnostic label is for 
treatment. Again few tests have been correlated with 
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treatment outcomes so that generally treatment implica- 
tions will also be unknown. 

The fourth implication of a diagnosis is for etiology. A 
test validated against a diagnostic label can embody noth- 
ing more in its scores than is known about the etiology of 
that condition. In psychiatry little is known of etiology 
so once more the test implications are severely limited. 

Payne concludes, 


The diagnostic test score is thus completely useless. It can be 
used validly to predict which label the psychiatrist who took 
part in the validity study would have assigned to a patient ..- 
it cannot be used validly to predict any of the consequences 
of this label. But the consequences of the label are all that the 
doctor is really concerned with (1958, p. 27). 


Future research may enable tests to predict these con- 
sequences but for the present it has to be accepted that 
diagnostic psychological testing of the kind outlined con- 
tributes little to psychiatric practice except in certain 
restricted areas such as the identification of behaviour 
associated with brain disorder. i 

This discussion shows that to ask for a diagnosis is not 
a very sensible referral for a psychiatrist to make. He 
should consider the diagnostic implications which interest 
him. When psychiatrists start asking psychologists for 
assistance in these areas then psychologists might be 
stimulated to more appropriate research than trying to 
predict what labels psychiatrists will put on patients. 

Williams (1965) suggests that the best contribution the 
psychologist can make to the problem of differential diag- 
nosis is to provide the detailed analysis, measurement and 
description of symptoms which Psychological tests per- 
mit. The psychologist is on dangerous ground if he makes 
diagnostic inferences from his test findings. Diagnosis, it 
is suggested, is the job of the psychiatrist and he can usc 
the psychologists test findings to put the patient into 
whatever diagnostic category he sees fit. This recommen- _ 
dation is particularly important where the nosological 


" 1 


39  Clarifying and Explaining Abnormalities of Behaviour 


concepts of psychologists and psychiatrists are at variance. 
They may agree about the basic data but disagree about 
their interpretation. 

A further objection to diagnostic psychological testing 
is that overlap of test scores given by patients in different 
diagnostic categories is generally so great that a case which 
is difficult for the psychiatrist to classify will also be 
difficult for the psychologist. This argument is based on 
the assumption that the psychologist is functioning, as 

$ Meehl (1954) has described, as a statistical clerk. Having 
obtained the patient's score he looks up a frequency table 
which indicates the probability of the patient falling into 
one or other of the diagnostic categories being considered 
i (see chapters 3 and 6). Since few tests have been developed 


tice use the same clinical methods of inference that psychi- 

atrists use. This does not mean that psychologists are 

operating as substitute psychiatrists. The data evaluated 
n by psychologists are mostly derived from psychological 
l tests and not from the psychiatric interview. 


Explaining behaviour 


"i Much behaviour which is difficult to explain is referred to 
n the psychiatrist who may pass the problem on to the 
ji psychologist for any light he may throw on the matter. 
: Examples of such behaviour are compulsive gambling, 
n cyclical vomiting in adolescence, indecent exposure, ano- 
$ rexia nervosa, dypsomania, psoriasis and school refusal. 

i The psychologist may consider the problem from the 
point of view of abnormal symptomatology or persona- 
lity assessment, or both. What he seeks is evidence as to 
whether or not there are psychological factors which will 
help explain the behaviour and so lead to an indication 
for treatment. 

Jones (1960) gives examples of investigations of indi- 
vidual patients with various forms of disorder including 
neuroses, behaviour disorders and psychosomatic condi- 
tions. The experimental method of setting up hypotheses, 
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to the stage where this is possible, psychologists in prac- - 
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and deriving deductions which are then tested under con- 
trolled conditions is shown to be applicable to such diverse 
problems as lack of persistence in a patient with a be- 
haviour disorder, disturbed relationship with the mother 
in an asthmatic patient and sexual identity in an anorexic 
patient (see also chapter 3). 


Personality assessment 


Apart from investigating specific hypotheses of disordered 
behaviour it is sometimes necessary to arrive at an overall 
personality assessment, for example in assessing suitability 
for psychotherapy or in giving a prognosis. For this pur- 
pose the psychologist has techniques for investigating (i) 
the patient's personality strengths and assets as well as 
his weaknesses and liabilities, (ii) his characteristic defence 
mechanisms and methods for dealing with stress'and con- 
flict, (iii) his self-concept and his attitudes towards himself 
as well as his attitudes towards other people and his inter- 
personal relationships, (iv) his needs, fears and aspirations 
as well as the specific stresses to which he is vulnerable 
and (v) his interests. 

Assessment may be required when behaviour therapy is 
being considered for a patient. The term behaviour 
therapy embraces a great number of techniques and 
regimes aimed at changing abnormal behaviour patterns. 
If a patient is to be allocated to the most appropriate 
programme for his individual needs then his case should 
be properly assessed. 


Vocational Guidance 


In giving vocational guidance the psychiatrist is fre- 
quently in the dilemma of trying to help the patient to 
make the maximum use of his potential yet at the same 
time wishing to protect him from environmental pressures 
which will prove too great for that potential. The psycho- 
logist is in a position to assess employment potential 


through aptitude tests and elucidation of motivation and H 
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interests. He can assess whether the patient's personality 
is compatible with his occupational interests and pre- 
ferences. 


Psychologists’ Attitudes to Referral Questions 


It is important that the limitations of psychological tests 
should be freely acknowledged. Unfortunately some users 
of tests (particularly of projective tests such as the Ror- 
schach) give the impression of a kind of omniscience in 
psychiatric matters. In addition psychiatrists are occasion- 
ally over-impressed by the claims made for tests or by the 
use of symbols and numbers in test reports. Sometimes the 
psychologist can give a clear solution to a referral problem, 
Often, he may only be able to provide information which 
may not be of immediate value in assisting a decision 
about a patient but which may be of value at some later 
review of the case. Often tests are of little value and the 
psychologist has to plead ignorance. The enthusiasm of 
the psychologist to demonstrate the value of his tests 
should not lead him to go beyond their limitations in 
solving referral problems. 

Occasionally a psychologist may feel that his work has 
been wasted when his findings on a case appear to be 
ignored by his colleagues. This could occur when com- 
munications between psychiatrist and psychologist are 
poor. The psychologist may then not appreciate the prob- 
lem the psychiatrist had in mind when referring the case 
or the psychiatrist may not be sufficiently acquainted with 
clinical psychology to appreciate the relevance and signi- 
ficance of the psychologist's report. A different situation 
arises when the psychologist's evidence is discrepant with 
the psychiatrist’s own formulation of a case. This may 
lead to a rethinking of the case. But if the psychologist’s. 
evidence cannot be reconciled with the other evidence 
available then the psychiatrist is taught to trust his own 
judgement. A doctor is trained to give credit to his judge- 
ment and to consider evidence from different sources in 
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the light of the whole. This is necessary as long as he is 
also trained to have insight into the common human 
failing to look for evidence which supports and to ignore 
that which conflicts with one's hypotheses, 


Formulating Problems for Referral 


There is a type of referral which is clearly to be discour- 
aged. This is the vague referral such as 'personality assess- 
ment or ‘psychological assessment’. Anyone referring in 
this way has not thought out clearly what kind of infor- 
mation he wants from the psychologist. 

Psychiatrists should be encouraged to formulate any 
questions which they put to psychologists as precisely and 
specifically as possible. The way in which the psychologist 
chooses to solve the problem is of course left for his own 
decision. Where a clear formulation of a problem is made 
then the psychologist’s contribution becomes more rele- 
vant and to that extent more valuable. It is probably an 
advantage to the psychiatrist if he has to formulate as 
clearly as possible the problem which he is putting to the 
psychologist because in doing so he should be stimulated 
to review the case, 

In practice the formulation of specific problems is 
usually the outcome of discussions between psychiatrist 
and psychologist. What starts out as a general discussion. 
about a typical psychiatric decision such as treatment or 
disposal gets refined to some problem to which the psycho- 
logist can make a distinct contribution. The vague blanket 
referral is often a plea for help which discussion can 
translate into a specific problem. 

In considering a referral the psychiatrist should ask — 
himself whether psychological assessment will contribute 
anything to practical decisions about the patient which he 
will have to make. The only occasions when it is justifiable 
to refer a patient to the psychologist when it is clear that 
no practical consequences will follow his assessment are 
in teaching and research. This means that the psychiatrist 
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should formulate clearly for himself the decision on which - 
the referral has a bearing and he should make ‘sure the | 
psychologist is aware of the relation of the referral ques- 
tions to that decision. ' 

This will help the psychologist to select the best and - 
most appropriate test procedure for his assessment. A * 
request for an I.Q. may be made as we have seen for a 
number of reasons. If it is for assessing a patient's suita- 
bility for psychotherapy a vocabulary test such as the Mill 
Hill Test would be used. If the problem was one of voca- - 
tional guidance another test might be more appropriate. 
The question might be whether the patient had the in- 
tellectual capacity for a university course in which case 
the A.H.5 would be more appropriate than the Mill Hill 
Vocabulary. 


Methods of Assessment 


"The first step in assessing a patient is to define the prob- 
lem. This was the subject of the last chapter. The next 
step is to lay down a scheme for solving the problem. This 
involves deciding what information is required and ho: 
that information is to be gained. The final step is to dra Y 
conclusions from this information. What does it signif ss ws 
Does it provide a solution to the problem? : 

An examination of the strategies adopted to elicit in- | 
formation and the methods of drawing inferences from - 
that information reveals three methods for investi- 
gating patients: the statistical, the clinical and the experi- 
mental. In actual practice a psychologist may use any one 
or any combination of these methods in dealing with a 
particular assessment problem. In this chapter the main 
features of the three approaches to assessment are out- 
lined. 


Statistical Inference 
Description 


The main features of this method have been described by 
Meehl (1954). The aim is to produce a test with standardi- 
zation such that when administered to a patient, his score 
can be checked against the tabulated scores of standardiza- 
tion groups and he can be classified accordingly. When 
research has produced the kind of data for this method to 
be adequate there is no subjective interpretation of results 
and no use of clinical acumen in the classification of an 
individual patient's score. Once the patient has produced 
a score the classification of that score can be done by any- 
one trained to read the tables — a person Meehl calls a - 
statistical clerk, 
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; It should be pointed out that it is the mode of drawing 
inferences from the data which is described as statistical, 
not the nature of the data which may be objective or 
subjective, quantitative or qualitative. 

An illustration of the actuarial method of inference is 
provided by the Nufferno Tests of intellectual speed and 
level (Furneaux, 1956). It is known that schizophrenics 
are abnormally slow at problem solving. This fact can be 
used to distinguish normals, neurotics and schizophrenics. 
For any given level of intelligence as defined by the 
accuracy score, the relative frequencies of normals, 
neurotics and schizophrenics achieving various speed 
scores can be determined. Thus for the accuracy score 
range 10-12 the ratio of schizophrenics to normals scoring 
in the speed range 160-164 is 9:1. The probability of a 
patient who scores in these ranges being schizophrenic is 
therefore 0-9. Similarly it can be shown that the prob- 
ability of his being neurotic is 0-67. 

Once a patient’s scores on the accuracy and speed tests 
are known, anyone trained to use the table could arrive 
at the probability of the patient belonging to one group 
or another. In addition all users of the table should come 
to the same answer, barring clerical errors. 

The second illustration involves the use of M.M.P.I. 
profile signs to distinguish psychotics from neurotios, It 
was originally hoped by the constructors of the M.M.P.I. 
that the scales developed from comparing groups of 
psychiatric patients with normals would help in the 
diagnosis of patients. This hope was not fulfilled. Instead 
of, say, the schizophrenics having a single peak on the 
schizophrenia scale it turned out that they often had . 
several high points. The next step was to look at the pro- 
files and try to distinguish clinical groups on the basis of 
certain signs. 

At first this was done impressionistically. Later workers 
attempted to make explicit the rules on which their im- 
pressions were based. Meehl and Dahlstrom (1960) discuss 
a set of sixteen rules (presented in Marks and Seeman, 
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1963) which are arranged in sequence for identifying 
psychotic and neurotic M.M.P.I. profiles, : 


One reads through the list of rules in order until one comes 
to one which covers the profile under consideration. Appli- 
cation of the rule to this profile then results in one of four 
outcomes: Profile ‘psychotic’ (P), profile ‘neurotic’ (N), pro- 
file indeterminate (I), or ‘proceed to next relevant rule’. In 
this manner all profiles are finally classifiable under one of the 
first three rubrics, P, N, or I. ... The rules, while complex .. . 


can, after a little practice, be applied by a clerk in less than a 
minute's time, 


In an extensive cross validation study (N=988) 30%, of 
the profiles were classified as indeterminate with regard to 
the psychotic-neurotic distinction, Of the rest, 76% were 
correctly identified. This level of discrimination is 
superior to the impressionistic profile assessment of 
individual clinical psychologists. 

Once again anyone trained to apply the rules can 
classify a test record and all users of the rules should come 
to the same conclusion for each record. 

Statistical formulae have been derived (Payne and 
Jones, 1957; Rosen, 1966) for the purpose of comparing 
test scores. Psychologists are frequently interested in 
changes in a patient’s test scores over a period of time 
and also in discrepancies between scores on different tests — 
taken by a patient. It does not matter whether the test 
itself is a personality questionnaire, an intelligence test, an 
interest inventory or whatever, As long as the tests pro- 
vide continuous scores and as long as the required 
normative statistics are available, such as means, standard 
deviations and test-retest correlations, these statistical 
methods can be applied. 

Consider the first problem of changes in a patient's test 
Scores over a period of time. There may be reasons for 

thinking that a patient has deteriorated or improved in 
Some way and tests are called upon to check this. A 
neurotic patient who has been treated may show a differ- 


Statistical Inference 


ence in some questionnaire measure of emotional lability 
given before and after treatment. The question is whether 
the change is larger than one might expect considering 
the errors involved in the measurement. We know from 
test-retest reliability coefficients that psychological tests 
are not perfectly reliable. If we can calculate the extent 
of the test error then we can say whether a change in score 
"is within the limits of that error or not. 

Rosen (1966) gives an example of a patient whose 
M.M.P.I. Ego Strength (Es) Scale score on admission 
was 34 and after four months of psychotherapy Was 
40. Is this a genuine improvement Or could the change 
in score be explained on the basis of practice effect and . 
test error? Rosen reports the means and standard devia- 
tions for a group of patients tested twice with the Es 
Scale, together with the test-retest correlation. He 
demonstrates that 19% of patients can be expected to 
improve their Es scores by six or more points without 
psychotherapy. One must therefore conclude that the 
increase in this patient's score lies within the limits of 
test error and does not indicate significant improvement. 
Payne and Jones give an example of a schizophrenic 
patient’s changes on the Wechsler Bellevue Test follow- 
ing drug treatment. 


The second problem concernin 
comparison of a patient's scores on different tests or sub- 
tests, On the Wechsler Adult Intelligence Scale (W.A.LS.) 
for example one may find a discrepancy between the 
Verbal and Performance Scales. Is this due to test error 
Or is it a reliable discrepancy? Field (1960) has provided 
tables to answer this particular question without one 
having to do any calculation. Suppose a man aged thirty 
years has a V.I.Q. of 106 and P.I.Q. of 96 giving a NV PS 
discrepancy of ten points. Field's tables show that the 
probability of obtaining such a discrepancy by chance is 
less than 0-05. We can conclude therefore that such a 
discrepancy is reliable and not merely due to test error. 


A related problem which frequently arises from test re- 


g test scores is the 
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sults is whether a discrepancy is abnormal or not. For 
instance how many people achieve a V.—P. discrepancy of 
ten points or more? Field's tables once again provide the 
answer ready made. At least 12% of people in the same 
age group as the thirty-year-old man have a verbal bias 
of ten or more points. It is left to the psychologist to 
decide what psychological significance this conveys. To 
achieve statistical significance at the usual 0:05 level the 
V.—P. difference would have to reach seventeen points. 

For this patient the conclusion can be drawn that his 
verbal bias is reliably ascertained although it is not suffi- 
ciently unusual to classify it as abnormal. 


Evaluation 


As noted in the discussion of measurement in chapter r, 
there is inevitably a loss of information in reducing be- 
havioural descriptions to scores for the purpose of actu- 
arial processing. This may be valuable if the discarded 
information is irrelevant but if it is significant and relevant 
then its loss may result in over-simplification. 

Piercy (1959) in discussing the assessment of intellec- 
tual impairment has shown that it would not be possible 
to quantify and build into a formula all the possible 
variations in behaviour that the clinician observes, The 
task is too complex and the clinician, it is argued, remains 
the most essential tool in assessment, 


Now it might in theory be possible to devise a battery of tests 
standardized as to administration, scoring and interpretation, 
which would accommodate the complexity of test procedure 
necessary to identify most cases of organic intellectual impair- 
ment. It must be stressed, however, that in most cases of mild 
intellectual impairment the logical structure of any thorough 
assessment of the evidence is extremely complex, and if for- 
malized would result in a test battery incorporating a formid- 
able decision procedure for administering successive tests. 
This decision procedure would be of prohibitive complexity. 
and, in addition, there would be a need for an extremely 
complex system of weightings if the various possible combina- 
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tions of response patterns are to be recognized and assessed 
within the framework of the scoring system. All this might, 
in theory, be done but only in the same sense that it is pos- 
sible to formulate a decision procedure for playing the perfect 
game of chess (p. 493). 


A formula or actuarial technique should only be used in 
conditions which are the same as those under which the 
technique was developed. If the conditions are different 
then the technique will give erroneous results. The ana- 
lysis of W.A.L.S. profiles illustrates this. Field's tables are 
based on the American standardization data given in the 
manual. Since no British standardization data are avail- 
able the use of these tables in Britain is really an act of 
faith. 

The trouble with cut-and-dried tests which give simple 
scores, easily processed in a mechanical way, is that they 
have an aura of correctness about them. The danger lies in 
their facile application in cases where they are not justi- 
fied, Paradoxically those who accept uncritically the find- 
ings from such procedures are often those who regard 
themselves as rigorous hard-headed scientists. 

The major difference in conditions between standard- 


ization sample and testing sample is likely to be in the 


base rates (see chapter 6). If this difference is ignored the 
test may give grossly misleading results. 

Uncontrolled variables (such as the base rates) may 
change over the period in which a test is used. The test 
may then become inappropriate even though it was appro- 
priate when first introduced. In order to keep it up to date 
it should be revalidated: and overhauled frequently. This - 
requires a great investment in man-hours which would 
have to be justified. A judgement would have to be made 
in each situation as to whether the benefit from the pro- 
cedure justifies the investment necessary to make it work. 

As it happens, the statistical method has not been used 
in clinical psychology as much as it could be, for precisely 
the reason that the basic data collection is an arduous 
business. This means that there are few tests for which 
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adequate data are available for the individual patient’s 
score to be processed actuarially. 

There are two major advantages of statistical methods, 
First, they are more likely to lead to appropriate decisions 
than the clinical method, Second, they lead to economies 
since, once the patient’s score has been obtained, this can 


be processed by clerical assistants or even computer. 
Meehl (1954) says, 


It is my personal hunch ... that a very considerable fraction 
of clinical time is being irrationally expended in the attempt. 
to do, by dynamic formulations and staff conferences, selective 
and prognostic jobs that could be done more efficiently, in a 
small fraction of the clinical time, and by less skilled and 
lower paid personnel through the systematic and persistent 
cultivation of complex (but still clerical) statistical methods. 
"This would free the skilled clinician for therapy and research, 
for both of which skilled time is so sorely needed (p. vii), 


Clinical Inference 
Description 


When no statistical data are available the clinical method. 
is usually used, This method of analysing data and draw- 
ing inferences is the same as that used by physicians and: 
psychiatrists. It involves evaluation by the clinician of — - 
the mass of information which is available to him about ^ 
the patient. He processes this information and arrives at. 
an opinion about the patient's condition, In this pro- 
cedure of evaluation the psychologist compares the avail- 
able information with his knowledge of such conditions, 
"This knowledge will be learned from textbooks, from the 
research literature, from teachers and associates, and from 
his own experience of similar cases, 

The process of evaluation involves continual formula- 
tion and reformulation. As each piece of information 
becomes available the clinician considers its possible 5 
implications in relation to all the other information he has à 
received. In diagnosis he considers the different possibili- 
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ties and attaches some probability estimate to them. If 
the patient rotates designs in the Bender-Gestalt Test the 
likelihood of his condition being organic increases. 

Hypotheses are tested by searching for information 
which will confirm or reject them. Gradually by a se- 
quence of such decisions and checks a final judgement is 
made. In the process some hypotheses will have been con- 
sidered and rejected. 

The whole extended process may be a reasoned argu- 
ment which is capable of being made explicit for public 
communication or it may be intuitive with steps that the 
clinician cannot make explicit. 

This method has been described as an art. 


In this approach the clinician behaves like the craftsman in 
that he attends quickly to what he knows to be significant, his 
skill develops with experience, and his work involves economy 
of effort. Like other crafts, it is dependent upon the assimila- 
tion of a body of knowledge which is shared by others; but 
expertness increases with practice until the practitioner is 
capable of recognizing clinically significant features with such 
rapidity that his steps of reasoning are not discernible to the 
uninitiated (Rodger and Mowbray, 1961, p. 167). 


At this stage of development the craftsman or clinician’ 
may not even be aware of all the features to which he 
responds, Because of this the clinician’s skill has been re- 
garded as lacking the qualities of objectivity and com- 


municability associated with scientific thinking. 
The clinical method of inference involves comparing 
the patient’s set of data with the configurations of cri- 


terion groups such as schizophrenics, brain damaged, de- 
pressed, etc. This is a matching operation with the 
established configurations acting as blueprints and in- 
volves examining test results with respect to their degree 
of approximation to known syndromes of disability. 

The data evaluated by the psychologist are not restricted 
to test responses. He may draw on the case history, his 
own interview and general observations of the patient. He 
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may use actuarial evidence described in the previous sec- 
tion where this is available, but generally this will not be 
sufficient and information from other sources will require 
to be evaluated as well. 


Evaluation 


The fact that experienced clinicians frequently disagree in 
their opinions on the same data is a measure of the sub- | 
jectivity of clinical inference, One often hears it said that tt 
the Rorschach findings on a Patient were such-and-such. 

To be correct one should refer to this Particular tester's — . 
findings on this patient's Rorschach. Where tests are in- 
terpreted by clinical judgement it is as important to know 
who tested the patient and interpreted the results as to 
know which test was used. : 

One reason for disagreement between clinicians is that 
inferences are heavily influenced by the clinician's theo- — - 
retical views. It is therefore inevitable that data will be put 
to different uses by different Clinicians. Bias can creep in. 
from several directions: the terms of the initial referral —— 
reliance on memory and the tendency to ignore evidence 
which is contradictory to one's clinical impression and to 
select evidence which confirms it. 

Another diffculty is that the agreed and substantiated - 
body of knowledge which clinicians acquire through train- 4 
ing is very limited. Sometimes what they learn is without 
scientific support and although it may start off as surmise, 
with time these speculations achieve the status of accepted — — 
fact. This makes it difficult for the clinician to remain 
with his feet firmly grounded in fact. 1 

As a result of these forces the Psychologist using the 
clinical method of inference faces the danger of going 
beyond what is justified from a patient's results. More " 
than that he may acquire a confidence in making clinical | 4 
inferences which, if subjected to a validation study, might i 
be shown to be unwarranted. To check these tendencies _ 
clinical judgements should be validated wherever Possible. 
This is necessary especially where the Steps in the reason 
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ing process cannot be made explicit. It has been demon- 
strated that clinicians’ judgements can range from accurate 
and useful to inaccurate and misleading. In other words, 
when clinical usefulness is checked some clinicians are 
found to be good and others bad. This exercise in valida- 
tion of clinical judgement is a salutary one which clini- 
cians should perform to calibrate themselves and to im- 
prove their functioning. Unfortunately such a validation 
study requires following up patients which is often diffi- 
cult for the busy clinician to arrange. 

The use of the clinical method in clinical psychology 
has been criticized as merely leading to a further psy- 
chiatric opinion. The implication is that the psychologist 
is duplicating the psychiatrist's work. Although this can 
happen; generally a psychologist is basing his opinion on 
information which is not available to the psychiatrist. 
Another criticism of the clinical method is that it tends to 
encourage the psychologist to accept the psychiatric con- 
ceptual framework so that his distinctive viewpoint as a 
psychologist is abandoned. 

Psychiatrists should not be misled into thinking that 
clinical psychologists use the statistical method when 
more often than not they use clinical methods of infer- 
ence. When the psychiatrist first comes into contact with 
psychological tests he is, as Zangwill (1952) has said, ‘per- 
haps unduly impressed by the prestige of numbers’ and he 
assumes that this is the way psychologists work, object- 
out recourse to the clinician's art. The word 
‘psychometrics’ conveys to him that the ideal state of 
statistical prediction has, in fact, arrived. When he realizes 
that it has not and that the psychologist uses clinical 
experience and judgement, he is just a little disappointed. 
The danger is two-fold. In the first place he may accept 
test results in an uncritical manner, and in the second he 
may come to reject them because they do not do what he 


expected. 
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Experimental Method in the Investigation 
of the Individual Patient 


Description 


"The clinical method in general and particularly in psycho- 
logy has very low status in the eyes of the advocates of 
scientific method, despite the fact that the processes are in 
many respects similar. Shapiro (1951) has suggested that 
there are considerable benefits to be gained from making 
explicit the clinician's implicit sequence of hypothesis for- 
mulation. He suggests that in so doing the formulation 
becomes more systematic and potential hypotheses are 
considered more impartially and carefully. Although the 
essential characteristics of the two methods are basically 
the same, the experimental method avoids many of the 
dangers of the clinical method and opens up new possi- 
bilities for investigation and application of psychological 
knowledge. 

The procedure involves first of all a survey of the in- 
formation available from all sources in the light of the 
particular problem referred. Explanations may be required 
for the patient's behaviour and Symptoms, for test dis- 
crepancies or for test Observations. In selecting problems 
for investigation the Psychologist has to keep the referral 
problem in mind since it is easy to choose problems that 
are irrelevant to the main issue. This caution does not 
apply to research-oriented investigations but to those in- 
vestigations oriented towards the patient's benefit, 

Next, all the hypotheses which might be set up to 
account for the behaviour are formulated. The particular © 
hypotheses that the Psychologist considers will depend on 
his knowledge of Psychiatry and Psychology as well as his 
own theoretical orientation, whether it be analytic, neo- 
Hullian or whatever, 

The practical implications of these 
sidered and a decision is made as to which ones to test, — 
'This decision will be guided by a consideration of the — 
Possible consequences, of each hypothesis being accepted y 


hypotheses are con- 
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or rejected, for the treatment and disposal of the patient. 
Will the test of the hypothesis have any practical effect on 
what is to happen to the patient? If not it is not worth 
testing. 

Often hypotheses will arise from which nothing follows 
except the facts they seek to explain. These hypotheses 
will be the first to be discarded. Other hypotheses may 
have no bearing on treatment and disposal so there is little 
point in testing them and they can also be discarded. Then 
certain deductions are made which are tested under con- 
trolled conditions. When the results of the testing are 
known a hypothesis may be rejected, modified or accepted. 
New problems may be thrown up by the testing and 
generally a revision of the original hypotheses will be 
necessary, requiring further testing. In this way a sequence 
of hypothesis formulation, testing and reformulation will 
be followed until a satisfactory solution of the referral 
problem is achieved. 

A particular feature of this approach is the emphasis on 
making controlled observations. The patient may be used 
as his own control a single matched control may be 
chosen, a suitable control group may be used, and finally 
available norms for tests may be used. 


Example 
The following case! is presented as an illustration of the 
experimental method in the investigation of the individual 
patient (Gathercole, 19662). A man with a long history of 
obsessional ruminations was judged to be well above aver- 
age intelligence on the basis of his apparent command of 
words. He used words like ‘metaphorically’, ‘commiserate’ 
and ‘irreparable’ which appeared well above the level ex- 
pected of a person working, as he did, as a hospital porter. 
One problem put to the psychologist was whether he was 
underemployed. The second problem was to assess 
whether there was any evidence of cognitive impairment. 
1. Grateful acknowledgement is made to Professor Fish for per- 
mission to quote this case. 
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He was a boxer and it was suggested that his brain might 
be damaged. 

Assessment of his word knowledge was required for an 
answer to both problems. The first stage in the investiga- 
tion was to determine whether the psychiatrist’s im- 
pression of high verbal ability was correct. A standard 
vocabulary test (from the W.A.LS.) was administered, on 
which he scored in the average range. This indicated that 
his verbal ability was not as high as had been thought. 
However it might have been that the words which he had 
used and which impressed the psychiatrist were in fact 
above average in level of difficulty. In order to compare 
the level of difficulty of these words with the W.A.LS. 
words which he had defined correctly, Thorndike and 
Lorge's (1944) word count was used. This book gives 
frequencies of words found in a wide variety of reading 
matter. - 

The more difficult words in vocabulary tests are also the 
more unusual ones, If the words used by the patient in- 
cluded some that were more unusual than those he could 
define correctly on the W.A.I.S. vocabulary test then the 
Psychiatrist’s impression would be confirmed. A list of the 
impressive words was constructed. Each word had been 
Spontaneously used correctly and later correctly defined by —— 
the patient. When these words, as well as the correctly — 
defined W.A.LS. words, were checked for frequency the 
psychiatrist’s impression was indeed confirmed. 

To account for the discrepancy between the frequency 
of words he used and those in the W.A.LS. he knew, the 
hypothesis was put forward that he had acquired a 'speci- - 
alist’ vocabulary. A garage mechanic might acquire E y 
specialist vocabulary of unusual words such as ‘sprocket?  - 
and ‘spline’. These words would not be a representative 
sample of his knowledge of all possible words of their 
frequency. It was thought that the patient's Preoccupa- —— 
tion with words might have resulted in familiarity witha — 
limited number of unusual words. À 

It follows from the hypothesis that he should have di 
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culty in defining words randomly selected from the Word 
Count but matched for frequency with the list of words 
generated by himself. A second list of words was con- 
structed and presented as a vocabulary test to the patient. 
The expectation was confirmed and the conclusions were 
drawn (i) that the W.A.LS. vocabulary score was a fair 
indication of his word knowledge and (ii) that his own 
word usage was misleading. 

This simple experiment had important clinical impli- 


. cations. It was important for the assessment of intellectual 


impairment resulting from brain damage. The base line 
from which any deficit was to be gauged was not as high 
as first thought. The experiment was also important for 
his vocational guidance. It could be stated that his work as | 
a hospital porter was appropriate to his intellectual level. 

This example of the experimental method in clinical 
psychology shows how basic research can develop from 
the study of a single case. A host of research problems 
arise in the search for hypotheses and techniques for test- 
ing them. The suggestion that the patient's specialist 
vocabulary resulted from his ruminations was not pursued 
but would have been enlightening. The discrepancy be- 
tween frequency of words used in speech and words de- 
fined in a standard vocabulary test may have diagnostic 
value. It might be possible to derive an index of intelli- 
gence from frequencies of words used in speech. 


Evaluation 

"This method has been criticized as being so time consum- 
ing as to be impracticable (Hamilton, 1964). Whether it is 
impracticable will partly depend on the need for an early 
decision for treatment or disposal. It is often said that 
there are few emergencies in psychiatry, so this criticism 
may be relevant less often than is supposed. Of course the 
patient may discharge himself before the investigation is 
complete, but this is a hazard of any other assessment 
method. The example given above shows that experi- 
mental investigations are not necessarily time consuming. 
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Although the experimental method has been applied 
mainly to problems of cognition and learning there is no 
particular reason why it should be restricted to these areas. 
Some studies have shown its value in investigations of 
problems of motivation and temperament, although few 
have attempted to test dynamic hypotheses. 

"The method of investigating the hypotheses will depend 
on the psychologist's ingenuity and creativity as well as 
his knowledge of experimental method and statistics and 
suitable techniques, As with any scientific ipeo 
success cannot be guaranteed by using this method, .- 


Choice of Method 


The psychologist is faced with the problem pf deciding 
which of these methods to use and when. Since the statis- 
tical and clinical methods have received most attention in^ — 
the literature these will be considered first. 

It might be argued that statistical methods are intrin- 
sically superior to clinical methods. In the development of 
Sciences, subjective methods of inference invariably give — 
way to objective methods which are more open to scrutiny 
and revision, Whilst granting this and acknowledging that 
we may expect to see a great expansion of statistical 
methods in clinical Psychology nevertheless the decision as 
to which method should be used in a particular clinical’ 
situation must be based on a direct comparison of the © 
efficiency of the two methods (see chapter 6 for discussion 
of test efficiency). A trial of strength is held in which both 
methods are applied to a single group of Patients. The 
method that correctly identifies the largest number of | 
patients is declared the winner. In the Meehl and Dahl- 
Strom report, mentioned above, the efficiency of the objec- 
tive rules for discriminating Psychotic from neurotic 
M.M.P.I. profiles, was compared with the efficiency of 
twenty-nine Minnesota clinicians. None of the clinicians 
correctly identified as many patients as did the objective 
rules. $ 


Choice of Method 


When Meehl (1954) reviewed studies in which the effec- 
tiveness of statistical and clinical methods had been 
directly compared, he mainly covered examples from 
vocational selection. Since that time clinical psychologists 
have been stimulated to compare the two methods in 
clinical work. It appears that although neither method has 
done very well, statistical methods are more often found 
superior to the clinical. However, for many purposes 
clinical methods are the only ones available. 

The experimental method has received much less atten- 
tion in the literature than it deserves. As psychologists — 
become more familiar with this approach they will be- — 
come more adept in its use. It will then become more — 
widely known and used. Where time is available and the 7 
psychologist can muster sufficient ingenuity to make it 
worth while it is a method that should be considered. 
There is a danger that clinical methods may be used where 
statistical or experimental methods are appropriate merely — 
because of inadequate understanding of these newer — 
approaches. There tends to be a delay between the time 
that new techniques become available and the time they — 
are introduced into actual practice. Since clinical methods | 
were first on the scene in clinical psychology, those psych- 
ologists who grew up with them tend to be reluctant tO — 
adopt the newer methods. 1 

In considering which method to use the decision pro- 4 
cedure of the psychologist should be as follows: 4 


(1) Where a statistical method is applicable and has been 
shown to be more efficient than the clinical method,useit. — 
(2) Where no statistical method is available or those that — 
are available are inferior, consider the experimental — 

" 


method. : D 
(3) If the experimental method cannot be applied use the - 


Clinical method. 


In actual practice the choice of method tends to be 
based not on a rational decision procedure like this but on 
ce. The psychologist who views himself 


personal prejudi 
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as a rigorous, hard-headed scientist will prefer statistical 
methods, not wishing to be associated with crystal-ball- 
gazing methods of clinical inference. If a psychologist sees 
himself as a sensitive clinician not wishing to be confined 
to the role of sausage-machine technician, he will prefer 
clinical methods. If his basic interest is in research, then 
he will be attracted by the experimental approach which 
gives him the opportunity of exercising his research skills 
and provides leads for opening up fields for research. 


4 Conceptualizing the Patient’ 


Introduction 


Assessment practice is profoundly influenced by the way 
in which the behaviour of patients is conceptualized. 
There are a number of concepts which enter into most 
discussions in psychiatry either overtly or covertly and it 
is useful to draw attention to them here. Partly this is a 
matter of defining terms and usage of words; partly it is 
a matter of defining universes of discourse. In psychiatry 
and psychology it is only too easy to use words incon- 
sistently and to shift from one evel of discussion to 
another. 

‘What is being assessed?" 
ter attempts to deal with. Th 


This is the question this chap- 
e aim is not to examine specific 
tests in order to fathom what they can assess. Nor is it to 
examine specific characteristics which are assessed by tests. 
The discussion will be at a more general level concerning 
basic concepts underlying the use of any test in the assess- 
ment of any characteristic. When 
down side by side it becomes easier to examine the general 
Although these are 


function of any particular test. 
theoretical issues it will become apparent that they have 


very practical implications for assessment. . 
The five topics have been arranged as bipolar opposites 


to contrast them merely for the sale of exposition. Tt 
should not be thought that the psychologist is required 
to make a choice between one extreme and the other. 
Each is complementary to its fellow, as will become 


clear. 


1i. Based on a paper presente 


Society, a summary of which appeared in Gathercole (1966c). 


these concepts are Set -— 


d to the Liverpool Psychiatric — 


62 


Conceptualizing the Patient 


Idiographic and Nomothetic Analysis 


A basic distinction is to be made between the idiographic 
and the nomothetic approaches in psychology. Allport 
(1961) makes this distinction to draw attention to the 
relative neglect of the idiographic approach which is 
concerned with the explanation of individual behaviour. 
The emphasis is on a specific person whose personality 
organization and trait constellation are unique. In order 
to explain the individual's behaviour, to predict his re- 
sponse to treatment or to give a prognosis, many different 
facets of this complex organism, as a unique individual, 
will have to be considered. 

In contrast, the nomothetic approach in psychology 
indicates an interest in general laws and principles of be- 
haviour applying to all individuals. Since the emphasis 
here is on groups rather than the individuals that make 
up the groups there is a concern with norms and group 
statistics. In this approach generalizations and universal 
variables or personality dimensions are sought which will 
reduce the complexities of behaviour as far as possible. 

These two approaches are not mutually exclusive; both 
are necessary and complementary in the study of psych- 
ology. This is demonstrated by the interest of Allport in 
nomothetic research and by the nomotheticists’ interest 
in individuals (Cattell, 1 965). 


It is not necessary for the clinical Psychologist to feel. 


that he has to make a choice between these two 
approaches. In his daily work he will find that he has to 
make use of the methods and knowledge of both 
approaches. Nevertheless, it is useful to distinguish them 
in order to see in what ways they have influenced 
developments in clinical psychology. 

From the nomothetic point of view the unique in- 
dividual can be represented as the point of intersection of 
a number of quantitative variables. His position in this 
network identifies him uniquely, but this is not to deny 
that he shares many features of his behaviour with other 
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people. Allport has sharply critized- this representation 
of the uniqueness of individual personality by pointing 
out that variables interact and cannot be regarded as 
completely independent. Both Cattell and Eysenck have 
been quick to acknowledge the need to investigate the 
interaction of traits (Cattell, 1965; Eysenck, 1966). 

The clinical psychologist, therefore, in applying his 
knowledge of personality dimensions and general prin- 
ciples of psychology to the study of the patient he is 
concerned with, is constantly searching for ways in which 


his nomothetic knowledge can be related to that indi- 


vidual patient. 
Clinical psychology was for a long time greatly in- 
fluenced by the nomothetic approach. Tests used with 


patients tended to be the products of the study of groups. 


The value of such tests lies in the fact that a patient’s test 
score can be compared with the norms or group data. The 
use of intelligence tests is an example of the way clinical 
psychologists studying individual patients have profited 
from tests devised primarily to study groups. One of the 
difficulties with such methods is that for purposes of 
diagnostic classification such tests are generally of little 
value. This is because there is usually a great amount of 
overlap of scores between diagnostic groups. Although the 


mean scores of a group © : 
neurotics on the Neuroticism Scale of the E.P.I. are sig- 
nificantly different, the score of an individual patient will 
very often be of no help in diagnosis because of the 
problem of overlap. 

There has however been a distinct move towards de- 
vising techniques and methods for studying individual 
patients in their own rig 
Osgood's semantic differentia 
niques for measuring aspects 


reference to group data. AU 
The Q-sort technique is another individual method. 


This has perhaps found its greatest application in the 
assessment of patient’s attitudes towards themselves. 
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Shapiro's Personal Questionnaire is a method in which 
each patient generates the items on which he will rate 
himself on various occasions. 

Shapiro has been a consistent proponent of the need to 
study individual patients in their own right. His advocacy 
of the application of the methods of experimental science 
to individual problems is a further development away 
from interest in groups and towards individuals. 


Phenotypes and Genotypes 


Psychological assessment is concerned both with describ- 
ing behaviour and explaining it. The first stage is to 
describe, and psychological techniques have'been devised 
because they are considered to have certain advantages 
over the description of behaviour based on the psychiatric 
interview. Only when the behaviour has been pinned down 
adequately can one begin to search for explanations of 
that behaviour. It frequently happens that an observed 
item of behaviour such as thought blocking can be pro- 
duced by several causes. The patient may have sufficient 
insight to stop himself expressing psychotic ideas in case 
he gets locked up; his attention may suddenly be taken 
up with something irrelevant; he may go blank so that 
he has no thoughts to express; he may have too many 
thoughts to express; he may have too many thoughts and 
be unable to select from amongst them. The behaviour 
observed in all these cases may be indistinguishable and 
yet it is determined by a variety of causes. 

Lewin (quoted in Allport, 1937), borrowing terms from 
genetics, called the overt behaviour the Phenotype and 
the underlying cause the genotype. The phenotype is 
analogous to the final common pathway in the nervous 
system. 

A genotype may, of course, give rise to different pheno- 
types. A bereavement may precipitate mania in one person 
but depression in another. The experience of failure, which 
is a genotype, drives one person on to try again until he 
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succeeds but causes another to give up and lose hope. The 
fire that melts the butter hardens the egg. 

The reason why one genotype may have different effects 
is that genotypes interact. The cause in which we are in- 
terested, say the experience of failure, may occur in the 
presence of a variety of other causes or genotypes which 
will modify its expression as a phenotype. 

It has been noted that psychological tests are useful in 
describing phenotypes (overt behaviour) The problem 
here is whether they can help in elucidating genotypes. 
That is to say, what is their explanatory power? 

In the case of mental defect an I.Q. figure will merely 
indicate the phenotype of mental defect, It will not en- 
able us to distinguish between mental defect due to the 
normal variation in intelligence and mental defect due to 
some abnormality such as brain damage resulting from 
birth injury. In order to do that one has to discover some 
other phenotypes which are more specifically related to 
the genotypes being considered. For instance certain types 
of perseverative response are more likely to be produced 


by exogenous or pathological mental defectives than 


endogenous defectives (see diagram). 


Maw: ee ee 
Genotypes Phenotypes 


Genetic endowment —_y» 
1.Q. 60 


Brain damage at birth — 
M Perseverative behaviour 


MUNERE NA CONSE OMIT IUS E ESTEE 

What one has to do is to decide what the various geno- 
types or causes may be and then search for some other 
manifestations which are specific to each genotype and see 
whether they are present or not. 

Another example of the search for genotypes in the field 
of intelligence is the case in which one attempts to dis- 
tinguish a person’s intellectual capacity or potential from |. 
his educational opportunity and cultural background. In- 
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tellectual potential cannot be directly measured divorced 
from environmental influence. But one can estimate the 
roles of these two influences from a consideration of 
schooling and family background in conjunction with tests 
such as the Progessive Matrices and Mill Hill Vocabulary. 

Although such estimates making use of test data are 
undoubtedly more accurate than could be achieved with- 
out the data, there is still a margin of error involved. 

In the field of temperament, knowledge is very much 
more limited so that test data are lacking which might 
help to provide an estimate of the relative influences of 
constitutional factors such as predisposition to anxiety 
and of environmental factors such as stress, 

As an example consider the case of a spastic girl who 
easily gets depressed and anxious in the face of frustra- 
tion and stress. Her emotional control is limited. Is this a 
direct consequence of brain damage or is it the result of 
difficulties which her spastic condition has Produced? 

The examples given above show that Psychological tests 
can be extremely useful in explaining some forms of 
behaviour, but useless in explaining others. Where they 
contribute little, this is not necessarily because they are 
inherently inappropriate. Generally it is because the neces- 
Sary research has not been done, 


Abnormality and Disease 


A psychological test is useful in so far as the behaviour 
elicited can be classified and used to predict something 


about the person tested. It is therefore important to know 
what sorts of classes of behaviour a. 


psychiatry. In other words: what di 
signify? 

Frequently psychologists will be attempting to decide 
whether a test response signifies normality or abnormality, 
illness or health. It is obviously important to have a clear 
idea as to what these terms mean. 

"There are currently held a variety of views on whether 


re being used in 
Oes a test response 
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psychiatry is concerned with disease entities or dimensions 
of personality. With some conditions a disease has been 
established which accounts for the behavioural disorder. 
G.P.I. presents a wide variety of behavioural symptoms, 
but these are determined in part by the previous person- 
ality and in part by the spirochaete. Many psychiatrists 
are expecting or hoping for something similar to the 
spirochaete to turn up to account for schizophrenia. 

Traditionally, medically orientated psychiatrists have 
sought to classify and categorize. If there were no etio- 
logical grounds for classification then attempts were made 
to classify on the basis of the clinical picture. Syndromes 
or symptom clusters were sought which it was hoped 
would serve until etiological justification was forthcoming. 

A number of writers have been questioning the useful- 
ness of this search for disease entities and seek to delineate 
abnormalities of behaviour by reference to universal per- 
sonality dimensions particularly in the field of the so- 
called functional disorders. 

"These problems are central to psychiatry and attempts 
at description and explanation of behaviour will be greatly 
affected by the view espoused. The kind of techniques. 
devised for assessment will depend on whether a dimen- 
» sional or a disease entity view is taken. 

t The history of the M.M.P.I. illustrates the difficulties 

í involved. It was devised *... to provide an estimate of 
3 symptomatic syndromes commonly recognized among per- 
j sons with clinical problems.... The Scales were not ex- 

^ pected to measure pure traits nor represent discrete 
i etiological or prognostic entities’ (Hathaway and Mc- 
3 Kinley, 1951, p. 22). The outcome was that items con- 
cerned with normally distributed personality traits were 
mixed in with items concerning physical and nervous 
disorders, The interpreter of an M.M.P-I. protocol is 
liable to become confused because he has to try to work 
in both a dimensional and a disease entity framework at 
! the same time. 

How is the term ‘abnormal’ us 


ed in connexion with 
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behaviour which can be classified on the one hand as the 
result of illness or on the other as deviation from the 
norm along a dimension? To answer this question it is 
necessary to look at the three ways in which the term 
abnormal can be used in psychiatry. 

In the first meaning of the term a state which is 
statistically unusual is regarded as abnormal. Thus being 
clever is as abnormal as being dull in this usage. In the 
second meaning some ideal standard is implied such that 
falling short of this standard is abnormal. These ideals 
are usually socially determined. Thus being clever is 
regarded as desirable but being dull is undesirable and 
therefore only dullness is abnormal in this usage of the 
term. In the third. meaning some disorder of function is 
identifiable which defines an abnormal state. Thus some 
defectives are dull by reason of some pathological condi- 
tion such as phenylketonuria or microcephaly. Had they 
not been so afflicted their intellectual potential might well 
have been higher. The brain dysfunction therefore pro- 
duced psychological dysfunction. These pathological de- 
fectives have also been called exogenous defectives to 
distinguish them from the endogenous or sub-cultural 
defectives in whom the subnormality of intelligence is due 
merely to the usual processes of distribution of the genes 
which govern intellectual potential in the healthy popula- 
tion. No malfunction is Present in the endogenous 
defectives so they are not abnormal in the third sense. 

These three different meanings of the term abnormal are 
frequently confused. It is possible of course for a person 
to be abnormal in all three senses, A Pathological defective 
for instance is (a) statistically unusual, (b) falls short of the 
social ideal and (c) exhibits disorders of intellectual function. 

Further confusion arises when the terms disease, illness, 
sickness, pathological and morbid are equated with any 
but the last of these meanings of abnormality. Attempts 
to clarify these concepts have been made by Jaspers 
(1913), Schneider (1958), Szasz (1960), and Eysenck 
(1960), amongst others. These writers distinguish on one 
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hand those disorders of behaviour which are concomitant 
with organic changes, such as in delirium and, on the 
other, those disorders which cannot be regarded as having 
a morbid organic cause. 

Conditions of the first type involving lesions of the 
nervous system are regarded by these authors as illnesses 
and classified as neurological. Conditions of the second 
type are not regarded as illnesses. Maladjustment or emo- 
tional disorder may be better terms to use. 

Endogenous or sub-cultural mental defectives may not 
be able to function in a fluid industrialized society, but 
they are not regarded as being ill, despite the fact that 
they come under the aegis of psychiatry. In the same 
way psychopathic and neurotic people are not ill. 

According to Schneider, abnormal personalities are ab- 
normal in the first sense defined above, that is they are 
statistically unusual. Among this group of abnormal 
personalities is a subgroup of people called psychopathic 
personalities! which includes two further subgroups: 
those who suffer (the neurotics) and those who cause 
others to suffer (the sociopaths). Neither are to be con- 
sidered as ill or diseased, although their level of adjust- 
ment is poor. 

The reason why these psychopathic personalities come 
into contact with psychiatry is that morbid states are 
known to produce identical patterns of behaviour. Such 
morbid states may have to be excluded by medical 
investigations. Thyrotoxicosis often presents itself as 
anxiety neurosis, porphyria can present itself as hysteria, 
and neurasthenia can be mimicked by various physical 
conditions, These conditions are not actually neuroses and 
have to be classified as diseases. 

It can be argued that a 
neurotic behaviour may be pa 
In the same way that some peopl 


predisposition to develop 
thologically determined. 
e are educationally sub- 


1. Note that Schneider's use of the term psychopathic personality 
differs from English usage in which the term is generally reserved 
for the antisocial misfits (Mayer-Gross, Slater and Roth, 1960). 
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normal by virtue of some pathological state whereas others 

are so by virtue of normal genetic deviation, the constitu- ( 
tional basis of neurotic predisposition may be distin- 
guished. Some people will become neurotic by virtue of 
normal processes of genetic distribution of the properties 
governing neurotic predisposition. Others will become 
neurotic by virtue of some pathological change which will 
increase their predisposition to become neurotic. It is not 
being denied that experience plays a role in the acquisition 
of neurotic behaviour. The intention here is merely to 
examine the relevance of the term illness to neurosis. 
Neurotic behaviour will be the result of an interaction 
between environmental influences, especially in child- 
hood, and constitutional factors such as the ease with 
which anxiety or aggression are aroused. 

For the purpose of illustration consider the arousal of 
anxiety. Presumably there is a dimension along which 
people can be ranged from high anxiety arousal in 
response to stress to low anxiety arousal in response to 
Stress. This will be constitutionally determined originally 
and those with high anxiety response to stress will require 
a lower degree of stress to produce neurotic behaviour. 

The constitutional basis of this dimension may be 
genetically (endogenously) or pathologically (exoge- 
nously) determined, This is the same kind of distinction 
as that made in the classification of mental defectives. 
There is, then, an interaction between the degree of stress 
the individual is subjected to and his constitutional 


make-up. 
Dimension of Constitutional Predisposition 


Insensitive to stress «— —— y Sensitive to stress 
2 endogenous f 
A exogenous B 
Dimension of environmental stress 


Small stress <———___» Great stress 
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Neurosis may result from: 
(1) Predisposition a interacting with stress b 
(2 » zh » iat D 


(3) » B »  » 4 (andanystress 
greater than a) 

@) » B » »  » 4(andanystress 
greater than a) 


In the terms of Schneider and Szasz only (2) and (4) are 
illnesses resulting from pathological causes. 

Eysenck and Eysenck (1964) make the claim that the 
phenotype — neurotic behaviour — is assessed by the E.P.I. 
N Scale. The genotype — constitutional predisposition, or 
what the Eysencks refer to as the inherited degree of 
lability of the autonomic nervous system — is measurable 
by laboratory techniques such as dark adaptation, motor 
dexterity, conditioning, G.S.R. and so forth. This claim 
has not so far achieved wide acceptance and no attempt 
has been made to distinguish between the various types of 
constitutional predisposition mentioned above by means 
of such tests. 

Extravagant claims have been made by Cattell, Shagass 
and Eysenck, and others that such laboratory techniques 
are of demonstrated value in clinical assessment. Such 
optimism appears to be stronger in the laboratory than in 


the clinic, and it seems safe to say that these remain 


primarily research and not clinical tools at the present 
time. 
Foulds (1961) distinguishes between personality traits 


on the one hand and symptoms and signs on the other. 


a relatively consistent and 


A personality trait is taken to be 
personality variable (which 


enduring position, in respect toa 
is universal). 

Symptoms and signs o! 
from traits in that they are nei! 
enduring. Indeed they indicate 
tinuity of behaviour (P. 269). 


f mental illness are distinguishable 
ther universal nor necessarily 
a break in the normal con- 
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Foulds demonstrates that in the field of neurosis it is 
useful to distinguish hysterical and obsessional personality 
traits from hysterical and obsessional symptoms of neuro- 
sis. Although the symptoms tend to occur with the traits 
of the same name, cases occur in which obsessional symp- 
toms are associated with hysterical traits and hysterical 
symptoms with obsessional traits. 

Eysenck (1960) regards neurotic behaviour as merely 
one extreme of a dimension of neuroticism. Likewise psy- 
chosis is considered as lying at one extreme of a psycho- 
ticism dimension. These dimensions are regarded as 
normal personality traits and appear to do away alto- 
gether with the disease entity notion in the functional 
psychiatric states, Adams (1964), in discussing the use of 
the M.M.P.L, says ‘the clinical scales of the M.M.P.I. 
were initially validated against Kraepelinian disease entity 
diagnostic criteria. The results of the M.M.P.I. factor 
analytic studies imply that the Kraepelinian labels pre- 
sently employed in psychiatric diagnosis are non-existent 
verbal abstractions’ (p. 196). 

Clearly there are a number of different views on ab- 
normality and disease in psychiatry and clinical psycho- 
logy. The Psychologist has to try to decide whether he 
is assessing dimensions of personality or disease en- 
tities. Confusion frequently arises because these frames 
of reference are not distinguished. Users of the 


M.M.P.I. and Rorschach are particularly exposed to this 
risk. 


Structure and Function 


One task that nomothetically inclined researchers such as 
Cattell have set themselves is to identify the units of 
personality. They seek the basic traits or dimensions of 
personality which will permit each person to be described 
as briefly and as precisely as possible. By means of statis- 
tical techniques it has been demonstrated that many as- 
pects of behaviour, attitudes and interests, as well as 
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behavioural acts, are correlated. Factor analysis sorts out 
those qualities which tend to be associated. 

To the factor analyst, ‘personality structure’ refers to a 
person’s location on the dimensions produced by factor 
analysis. Cattell (1965) uses sixteen personality factors at 
present (he has a few more up his sleeve), some of which 
are combined to produce two second order factors. 
Eysenck (1960) has three major dimensions. Foulds 
(1965), eschewing the empiricist approach of factor analy- 
sis, has selected on rational grounds one dimension for 
conceptualizing the relationships between different forms 
of maladjustment. This dimension consists of increasing 
degree of failure to maintain mutual personal relation- 
ships. It extends from normality through personality dis- 
order, personal illness (neurosis) and psychosis to non- 
integrated psychosis. In addition he uses a personality 
trait — hysteroid: obsessoid — as well as several clinical 
scales. 

There are numerous tests on the market purporting to 
provide dimensional descriptions of individuals (e.g. 16 
P.F.). It is worth noting that these tests generally do not 
provide a direct measure of a dimension. Rather they 
are enumerations of qualities which contribute to the 
operational definition of a dimension. Thus a person 
who acknowledges in a neuroticism questionnaire that he 
blushes easily, is moody and his feelings are easily hurt is 
regarded as more neurotic than a person who does not 
have these experiences. This is rather like identifying a 


tall person as one who acknowledges that he usually finds 


himself looking down at people he talks to and has diffi- 
n cinema seats. There 


culty in finding space for his knees i 

is no direct measure of neuroticism as there is for height, 
so reliance must be placed on such indirect measures as 
adding up different qualities which subjects admit they 


Possess. 

If it is accepted tha 
fully described in terms of his loc 
dimensions, the question arises as 


t a person's behaviour can be use- 
ation on a number of 
to what is to be done 
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with this description in the case of the individual patient. 
The problem of combining and integrating the informa- 
tion provided by a dimensional description for the pur- 
poses of making decisions about patients is one for which 
only partially satisfactory solutions have been devised. 
The clinical method may be used, in which case the pro- 
file is subjectively evaluated by the clinician. Statistical 
methods have also been developed for the purpose of in- 
tegrating a patient's scores on several dimensions. Cattell, 
who is foremost in this field, has described several 
methods (Cattell and Eber, 1957). The principle of profile 
matching is to compare the patient's profile with those of 
criterion groups such as anxiety hysterics, schizophrenics 
and so on. Two techniques of profile matching are avail- 
able. In the first an estimate of the goodness of fit of the 
given individual's total profile to any criterion profile is 
made. This is done by calculating a profile similarity co- 
efficient — rp. It is claimed that such coefficients can be 
used to assign a patient to a typical syndrome category. 
In the second technique for profile matching, a *qualifica- 
tion grid' is available for each diagnostic category. This 
grid gives weights for each factor Score. À patient's factor 
weights corresponding to his factor scores can be added 
up to give a total weighted score which is used to indi- 
cate the likelihood of the patient's belonging to any par- 
ticular diagnostic category. 

Apart from profile matching, a technique for ‘criterion 
estimation by the specification equation' is described. This 
islike a multiple regression equation. 

"These statistical techniques have been introduced rela- 
tively recently and it is too early to say how useful in 
clinical work they may become. One difficulty appears to 
be the shortage of suitable reference group profiles and 
data. 

In addition to the factor-analytic approach to dimen- 
sion definition there is a developmental or genetic 
approach. Behaviour can be considered as varying along 
an evolutionary scale from the primitive, undifferentiated, 


" 
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global behaviour of the infant to the individuated, differ- 
entiated behaviour of the mature person. In childhood 
growth, there is evolution, progression or individuation. 
The child moves through a sequence of developmental 
stages. At each stage new skills and abilities become differ- 
entiated but also integrated in the upward movement to- 
ward maturity. 

Psychiatry is often concerned with people in whom this 
process has been reversed so that instead of evolution 
there is dissolution, instead of progression there is re- 
gression as in a dementing process. In addition psychiatry 
is concerned with people who have not developed to full 
maturity, whose behaviour has become fixated at a lower 
level. Homosexual attachment may be regarded as a nor- 
mal phase of sexual development but a person may 
become fixated at this level and fail to progress to hetero- 
sexual relationships. 

It is often wrongly thought that genetic psychologists 
claim the pattern of personality in regression to be the 
same as the pattern in the developing child. The young 
child, the senile dement and the deteriorated schizophrenic 
may all produce perseverative behaviour. In this respect 
all three are alike and it is instructive to compare them in 
this particular. But there will be many differences in other 
respects. 

The writings of Jackson (1938), Piaget (1929), Freud 
(1959), Werner (1948) and Goldstein (1939) are all 
directed to elucidating the stages of development in dif- 
ferent aspects of personality and to the mechanisms of 
evolution and dissolution. Significantly, these writers have 
used mainly idiographic methods of investigation. 

There are then a number of ways in which the psychi- 
can be conceptualized : firstly in terms of 
secondly in terms of rationally 
irdly in terms of an evolu- 


atric patient 
empirically derived factors, 
defined dimensions and th 


tionary scale of development. 
This concern with dimensions and factors has gradu- 


ally given way to a concern with mechanisms and pro- 
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cesses. Indeed, if disordered behaviour is to be regarded 

as a disturbance of functioning, then the mechanisms \ 
involved would seem worthy of study, This need was recog- 
nized by Rapaport (1945) who deplored the lack of theo- 
retical context of psychological tests and commented, ‘the 
realm of psychological functions tapped by testing pro- 
cedures . . . has barely been touched by systematic investi- 
gations’ (vol. 1, p. 4). Twenty years later psychologists are 

still crying this message in the wilderness (Williams, 
1965; Tolor and Schulberg, 1963). Williams points out 
that clinical psychologists have been too involved in devis- 

ing tests and subsequently applying them to a wide 
variety of subjects, Frequently this has been done merely 

to see if a test will expose differences between psychiatric 
groups and normals. This kind of work has generally 
arisen from the demands of psychiatrists for diagnostic 
tests which will aid classification of patients, Often it is 
quite devoid of any theoretical justification. 

The extensive use of factor analysis has led to the 
belief that there are ‘pure’ Psychological functions and 
that ‘pure’ or homogeneous tests of these functions can be - 
devised. a 

"The functions arrived at by factor analysis are abstrac- 
tions and can be viewed in different ways. Intellectual 
functioning, for instance, has been shown by Furneaux 
(1960) to be usefully regarded as being made up of three 
components — speed, persistence and level. There are 
individual differences in the level of difficulty or ceiling to 
which people can rise in solving problems when given un- 
limited time. In addition, some People are slower in prob- 
lem solving than others even though they may achieve the 
same level of difficulty if given unlimited time. Persistence 
varies too. The person who gives up easily does not give 
himself the same chance of achieving a higher score as the 
tenacious person. 

The Block Design sub-test of the W.A.I.S. (Wechsler, 
1955) is regarded as a reasonably pure measure of intelli- 
gence (correlation coefficients are around 0-70 with full 
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scale score). There are, in fact, a number of processes in- 
volved in constructing block designs. First there is the 
perceptual aspect — reception of the design. Then there is 
the visual analysis and lastly the executive or motor 
aspect. In addition, memory, set and attention are in- 
volved. Breakdown could occur at any point in the chain 
of processes. The phenotype (error in construction) gives 
no indication as to the location of the genotype. 


Psychological tests can no longer be regarded as tests of 
specific restricted functions. They should rather be conceived 
as inducing sample performances, or specimens of behaviour, 
in which some aspect of the person, say his problem-solving 
ability, has designedly been given prominence, but to which 
many other forces in his personality contribute. We should 
recognize that we can never arrange a situation in which just 
one important variable is tested. Our problem-solving test will 
perhaps be also a test of frustration tolerance, a test of control 
over anxiety, a test of level of aspiration, ... What we say 
about our subjects problem solving thus becomes a statement 
about his observed problem solving under a specific set of 
circumstances, external and internal. We have not measured 
his capacity; we have merely taken a specimen of his use of his 
capacity under particular conditions (White, 1952, P. 10). 


Quantitative and Qualitative Changes 


The difference between behaviour which is regarded as 
normal and that which is regarded as psychiatrically ab- 
normal may be either quantitative or qualitative. Foulds 
makes the disconcerting comment that *psychologists can 
produce continua like rabbits out of a hat by an artificial 
sleight of mensuration' (1965, P- 211). By what criteria 
does one assess whether behaviour is continuous or dis- 
crete? s 

Many psychiatric symptoms are apparently so alien to 
the normal person’s experience that they have always been 
regarded as qualitatively different. Hallucinations, delu- 
sions and conversion symptoms are examples. However, 
examination shows that most symptoms can be produced 
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in normal people given the right conditions: isolated 
people such as lone voyagers hallucinate, dreams and hyp- 
nagogic phenomena are not far removed from hallucina- 
tions, drugs such as the psychotomimetics can provoke 
psychotic experiences, stress such as in war can induce 
symptoms of neurosis and psychosis. Comparison of sub- 
jective experiences such as imagery (McKellar, 1957) sug- 
gests that the difference between normal and abnormal 
functioning is one of degree. 

In longitudinal observation of patients the transition 
from one condition to another may be traced, so that what 
appear to be two qualitatively different states may be 
only extremes of a continuum. Loss of insight is often 
sudden but it may be gradual, and where it is gradual the 
change can be seen as one of degree, Where these transi- 


tions are rapid it appears as if a qualitative change has 
taken place. 


Mechanisms used by normals, such as repression or 
dissociation, may be used excessively by say hysterics and 
this can be seen as a quantitative difference, 

These considerations suggest that in many cases what 
at first sight appear to be qualitative differences may in 
fact be quantitative, 

It is possible that both quantitative and qualitative 
changes may take place together. This is not uncommon — 
in nature: for instance the Physical changes from ice to — 
water at o^C and water to steam at 100°C, The quantita- 
tive change is in temperature and the qualitative change is 
in the physical state. 

If a genetic or developmental view is adopted then it 
becomes apparent that with growth and individuation 
new qualities emerge. Raven for instance has spoken of the 
development of eductive reasoning or the ability to reason 
by analogy as a salmon leap in the river of life. A new 
quality of thinking has emerged. Clearly intelligence in- 
volves qualitative as well as quantitative differences, The 
emphasis on intelligence as a quantitative dimension tends 
to obscure the qualitative differences, 


Quantitative and Qualitative Changes 


It was pointed out above that many psychological 
dimensions are measured by adding up different qualities 
as for instance in questionnaires. In the discussion of 
phenotypes and genotypes it was pointed out that a bit 
of behaviour, such as that involved in getting a score on an 
intelligence test, might be produced in different ways. 
Thus a different combination of qualities could produce 
the overt behaviour we are interested in. For example, on 
the dimension of intelligence three different people achieve 


a Wechsler I.Q. of 65. 


The first is a defective whose scores are: 


Verbal Scale I.Q. 65 
Performance Scale I.Q. 65 
Full Scale I.Q. $5 
The second is brain damaged whose scores are: 
Verbal Scale I.Q. 8o 
Performance Scale I.Q. 50 
Full Scale I.Q. $5 
The third is an illiterate delinquent with these scores: 
Verbal Scale I.Q. 50 
Performance Scale I.Q. E 
5 


Full Scale I.Q. 


ocated on the dimension of intel- 
I.Q. 65. But this figure is made 
eals these important dif- 
, 
measured by questionnaires such 
as the Manifest Anxiety Scale, the E.P.I. N Scale and the 
16 P.F. second — order anxiety factor, appears to draw on 
several components. Again a score on the general factor 
may conceal important differences in the pattern of scores 


on the specific factors. * va 1 
Foulds (1961) made an important contribution to the 


"These people are each 1 
ligence at the same point — 
up in different ways and conc 
ferences. : 

Emotional lability, as 
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discussion of quantitative and qualitative differences in 
abnormal behaviour when he distinguished traits and atti- 
tudes on the one hand, which emphasize the continuities 
of behaviour from symptoms and signs on the other, 
which emphasize disruption of continuity. In making this 
distinction he is attempting to separate universal person- 
ality traits which apply to the total population of normal 
and abnormal, from those features of maladaptation 
which are not universal. Although we are more or less 
honest (personality trait) we do not all have functional 
paralyses (symptom). 
As Foulds (1961) points out 


the distinction is not always simple, we:do all wash our hands. 
"The obsessional neurotic may wash his hands more often. This 
is a quantitative distinction only. The normal person, even if 
he is of obsessoid personality, feels free to decide whether or 
not he will wash his hands: the obsessional neurotic feels no 
such freedom and would be distressed by this compulsion 
itself or by interference with it. This is a qualitative distinc- 
tion, which implies either a symptom or a subjective sign 
(p. 265). 


The problem of conceptualizing in terms of dimensions 
crops up in the assessment of the behavioural effects of 
brain damage, Psychologists are often asked whether there 
is evidence of a patient being brain-damaged or not. Many 
tests are based on a comparison of a group of brain- 
damaged patients and a group of normals. Scores are 
derived and the likelihood that a subject falls into one 
group or the other can be found by comparing his score 
with the group data, This produces a dimension of ‘likeli- 
hood of brain damage’. Such a dimension receives some 
theoretical support from Lashley’s law of Mass Action 
which relates the amount of brain tissue removed to the 
degree of behavioural disturbance, 

In conditions such as senile dementia there is a 
relatively generalized atrophy of the brain which is related 
to degree of disorder of behaviour. The inference of mild, 


moderate and severe brain disorder from mild, moderate 
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and severe deficit on psychological tests in patients with 
senile dementia is probably justifiable. 

This use of dimensions is probably not very helpful. 
There is evidence to show that a person can undergo 
extensive brain operations such as leucotomy without 
appreciable effect on test results. Thus it is the location of 
the lesion which is often of paramount importance. It 
follows from this that the psychologist should be con- 
cerned with the quality of the performance on tests given 
to patients in the assessment of the behavioural con- 
comitants of brain damage. 

One of the reasons why the quantitative notion of brain 
damage has been so popular is that tests which give a 
single score are much easier to use than those which re- 
quire the painstaking observation and analysis of qualita- ' 
tive aspects of test performance. The exception to this rule 
is the Rorschach Inkblot technique which can be used in 
the assessment of brain damage. It requires quite complex 
analysis yet only provides an indication as to whether 
the patient is or is not likely to have suffered brain damage. 
It is of little help in defining the deficits produced by the 
brain damage. i 

The need for quantitative and qualitative studies to 
complement each other is seen in much psychological 
testing. In their detailed qualitative examination of 
patients with brain disorder both Goldstein (1939) and 
Luria (1966) neglected to provide the quantitative nor- — 
mative data for the tests they devised and used. Those 
psychologists who have invested heavily in developing | 
quantitative tests, such as Payne and Friedlander (1962) 
with tests of thought disorder, have neglected the detailed 
qualitative analysis of their patients’ responses. 

The question of continuity arises in the assessment of 


psychotic and neurotic depression. Is there a continuum . 
of increasing severity on which these conditions are best | 
thought of as lying; with psychotic depression being more 

severe than neurotic depression? Or are they best thought 


Rene P 
of as discrete conditions? Another continuity — discon- 
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tinuity problem is concerned with paranoid delusions. 
Many people consider patients with paranoid delusions as 
related by virtue of their position on a dimension of 
thinking disorder. At one extreme will be those with delu- 
sions but no thought disorder — the paraphrenics or para- 
noid psychotics. Along the dimension will be found every 
gradation from mild through moderate to severe disorder 
of thinking processes. Others consider paranoid psychosis 
and paraphrenia as quite separate categories from para- 
noid schizophrenia. 

It is probably true to say that every psychiatric con- 
dition can be thought of as continuous in some respects and 
discontinuous in others with every other condition as well 
as with normality. In other words there are similarities 
and differences. If one school of thought concentrates on 
the similarities and another concentrates on the differences 
they can maintain a controversy indefinitely. What has to 
be decided is what are the important aspects to be 
attended to and what are the trivial aspects which can be 
ignored. Importance will be gauged according to useful- 
ness in treatment and prevention of maladjustment. If 
dimensions are regarded as convenient fictions we want to 
know which ones are most convenient for what purposes. 


Conclusions 4 


An attempt has been made in this chapter to draw to- 
gether some of the concepts which underlie the use of psy- 
chological tests. In doing this it is hoped that individual 
tests may be seen in proper perspective. 

Setting out these topics in this way also enables one to 
see what lies at the root of many variations in assessment 
practice and of many controversies in this field. It also 
helps one to see what directions future assessment practice 
will take. 


- 5 Selecting Tests 


The Need for Selection of Tests 


There are a vast number of tests, techniques and pro- 
cedures at the psychologist's disposal. In addition to those 
published commercially there are those described in jour- 
nals, as well as those developed locally and unpublished. 
There are many established tools, many which have 
fallen into disuse, and many which contend to be the popu- 
lar tools of the future. Some tests are very widely used in 
practice, but this is no guarantee of their value. It would 
be unfortunate if choice of tests was affected by their 
popularity, for there are more rational guides for choos- 
ing tests than popularity. In this chapter some of the 
reasons are discussed why clinical psychologists choose to 
use some tests rather than others. Given the same assess- 
ment problem, two psychologists might use entirely dif- 
ferent tests. The aim here is to make the newcomer aware 
that he is making a choice when he decides to use a par- 
ticular test. The choice should then be a considered one. 

Throughout this book the terms test, technique and 
clinical instrument have been used interchangeably. The 
Standing Committee on Test Standards of the British 
Psychological Society (1965) has suggested certain dis- 
tinctions, as follows: 


(1) A test is any standardized device from which an objective 


quantitative score is derived. 

(2) The word ‘test’ has been casually used to refer to three 
different types of device for which an agreed standard usage 
should be adopted as follows: 


() Tests of attainment, for example in arithmetic, spelling, 


grammar, shorthand. SA : : 
(ii) Psychological tests of cognitive abilities, special aptitudes, 
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interests, or orectic functions. They include (a) group 
tests, normally employing pencil and paper, (b) tests 
designed to be administered individually, which may 
employ apparatus. 

(iii) Clinical instruments or quasi-test devices, which permit 
of a diagnostic assessment of individual performance, but 
which do not yield an objective score. 


The American Psychological Association (1966) in its 
Standards for Educational and Psychological Tests and 
Manuals suggests that devices for identifying interests 
and personality traits through self-report should not have 
the word ‘test’ in their titles. Rather they should be en- 
titled ‘inventories’, ‘questionnaires’, or ‘checklists’. No ob- 
jection is raised to the use of the word ‘test’ in reference to 
these devices in textual material for simplicity of language. 


The Use of Test Batteries 


At the present time a Psychologist selects the tests he gives 
to a patient according to the Particular assessment prob- 
lem posed, He might ask one Patient to fill out a question- 
naire and do some aptitude tests and another to interpret 
Proverbs and sort objects, 

In the 1940s and 1950s — early days in clinical psycho- 
logy — the use of standard batteries of tests for all prob- 
lems was common (Rapaport, 1945). Each patient was 
systematically given say the Wechsler-Bellevue, a Story 
Recall Test, a Sorting Test, the Rorschach, a word asso- 
ciation test and the Thematic Apperception Test (Schaf- 
er, 1948). This was justified by drawing attention to the 
inadequacies of tests. If one test was misleading another 
would provide a check. Cattell (1965) has drawn attention 
to this problem in his discussion of instrumentation fac- 
tors. It appears that certain aspects of behaviour are 
elicited only by certain tests. For instance several of 
Cattell’s personality factors are only identified by ques- 
tionnaires and as yet have no counterpart in other types 
of test. A standard test battery was also regarded as neces- 
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sary to tap different aspects and levels of the patient's 
personality. A single test might not be representative of 
the disturbed level or area. Nowadays many tests, such as 
Cattell's Objective-Analytic battery, are themselves made 
up of a number of tests but this is rather different from the 
use of batteries described above. The use of test batteries 
may be justified when a psychologist is testing blind. That 
is, when he is not acquainted with the patient's history and 
current difficulties. In such a situation the psychologist is 
expected to track down the diagnosis without assistance 
from any source other than his tests. 

Where the psychologist is asked a question or formu- 
lates a problem in the light of all that is known about the 
patient then there seems no justification for the routine 
administration of a test battery with the exception of cer- 
tain situations. In clinical work it may happen that cer- 
tain tests are very commonly required as, for instance, 
achievement tests in child psychiatric work. For research, 
for screening purposes and possibly in the training of 
clinical psychologists the use of a standard battery of tests 
may be helpful. In clinical work however there is the 
danger of using them unthinkingly without consideration 
of the questions they are being used to answer. Indeed 
they may be used to answer questions where they are 
irrelevant or of no practical value. For example when a 
patient with known memory deficit is referred for assess- 
ment of the extent of this deficit it would not be to the 
point to give the Rorschach. This test might throw light 
on the patient’s condition but would be irrelevant to the 
assessment of his memory. 

The danger of routine applicatio 
exists in the clinical approach. The 
clinician to rely on a few tried and 
as the W.A.L.S., Rorschach, Bende 
Although many other tests are avai 
made a decision to invest his time in 
may get to the stage where he uses them so 
his use approaches the battery method. 


n of a test battery only 
re is a tendency for the 
trusted old tests, such 
r Gestalt and T.A.T. 
lable the clinician has 
these few, and he 
frequently that 
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A clinical psychologist has to make the decision as to 
whether he is going to invest time and effort being trained 
and gaining experience with a few tests such as the Rors- 
chach and W.A.I.S. so that he can develop as an expert in 
the use of the clinical method or whether he is going to 
widen his experience so as to make a passing acquaintance 
with many tests. An argument in favour of the former is 
that only constant usage of a test will make the examiner 
aware of many pitfalls. Psychiatrists are often happier to 
rely on the judgement of a psychologist who has a lot of 
experience with a few tests than on the judgement of a 
psychologist who knows a lot of tests but has little per- 
sonal experience in depth of any single test. 

The value of knowing a lot of tests is that those which 
have specific uses can be applied when appropriate prob- 
lems arise, In testing for malingering it is useful to know 
of previous approaches to the problem (Jones, 1960). The 
danger of the second approach is that one becomes a jack 
of all trades but master of none to the detriment of one’s 
clinical contribution. 

Amongst psychologists using the clinical method there 
is a tendency to reduce the number of tests used, in con- 
trast with those using the statistical and experimental 
approaches where there is a distinct proliferation of tests, 
especially of the objective sort. 

This can be seen as a case of the bandwidth-fidelity 
dilemma discussed by Cronbach and Gleser (1965). Does 
the tester attempt to measure many dimensions crudely 
or one dimension accurately? An example of a wide band- 
width, low fidelity test is the Rorschach, which is claimed 
to measure many dimensions including intelligence, emo- 
tional control, reality contact, and maturity. Conclusions 
about any one of these should only be regarded as rough 
estimates. The Manifest Anxiety Scale is an example of a 
test having narrow bandwidth but high fidelity. It is 
specifically designed to measure only one dimension so that 
the range (bandwidth) of information provided by 
the M.A.S. is much more limited than that provided 
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by the Rorschach but its accuracy (fidelity) is much 
greater. 


Factors Influencing Choice of Tests 


Naturally where available those tests which have achieved 
acceptable standards of reliability, validity, objectivity 
and standardization will be given first preference (see 
chapters in Anastasi, 1961; Cronbach, 1961; Sundberg and 
Tyler, 1963). 

It is worthwhile repeating here the caution that a test 
which has achieved adequate validity in its development 
phase may only be used in clinical work with patients of 
the type used in the standardization. A common clinical 
use of tests is in cases where the diagnosis is in doubt. 
Ideally a test used for such a purpose should be stan- 
dardized on such cases. Follow-up would establish the 
diagnosis to be used for separating patients into groups of 
those with and those without the dysfunction being 
assessed, This procedure was used by Walton and Black 
(1959) in validating the M.N.W.L.T. Often test developers 
do not include this phase in the standardizing of their 
tests. Frequently a test is administered to groups of sub- 
jects where the diagnosis is clear. Usually discrimination is 
good and the test becomes adopted enthusiastically for use 
in a clinical situation for which appropriate data are not 
available. The moral is an old one: tests should be used 
with the population on which -they have been stan- 
dardized. 

It must be acknowledged that there are very few tests 
which are completely acceptable technically, and for 
clinical use imperfect tools have to be tolerated very often. 
In assessing the significance of a patient's results the 
Clinician has to take these imperfections into account. 

Evaluations of tests are available (Anastasi, 1961; 
Buros, 1965; Nunnally, 1959) which give guidance on the 


usefulness of individual tests. f 
The American Psychological Association (1966) has 


88 


Selecting Tests 


-published a set of Standards for Educational and Psycho- 
logical Tests and Manuals by which test users can judge 
tests for themselves. If these Standards are applied 
systematically a test's imperfections are quickly high- 
lighted. 

Selection of tests will depend on the type of problem 
referred. There are some problems, such as the question of 
organic impairment, for which a variety of tests have been 
devised. There are others for which tests are available 
having direct relevance, although not necessarily devised 
for that purpose. Jones (1960) describes the use of "level 

' of aspiration’ techniques with a man having psychoso- 
matic symptoms and a history of failure at two univer- 
sities. Situations may arise for which no tests are available 
when it would be necessary to construct suitable tests ad 
hoc. This would occur more frequently in using the ex- 
perimental method. The decision as to what tests should 
be given in a particular case will generally be taken in the 
light of what is already known about the patient. As each 


test is given, the situation is reviewed and in the light of |.— 


the knowledge provided by the tests already given the 
decision as to which test to use next, if any, will be taken. 
For instance a man who is known to have cerebral 
arteriosclerosis is referred for assessment of evidence for 
cognitive deterioration associated with brain disorder. He 
Scores average on most of the W.A.LS. subtests and the 
memory tests given. However on the Similarities subtest 
he scores significantly lower, This fact now becomes the 
focus of further enquiry and tests of verbal reasoning are 
given to establish the importance of the low Similarities 
subtest score. Had he scored average on that subtest then 
testing might have been brought to a halt. The actual 
sequence of tests given to any particular patient will 
therefore depend not only on the referral problem but 
also on his performance on each successive test. 

Test selection will also depend on the method chosen to 
tackle the problem posed. If a technique is available with 
adequate actuarial data for the statistical method of in- 
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ference to be applied then this should be used. Frequently 
this will not be the case and one of the other methods will 
be used. If tests are available which require clinical evalua- 
tion and the psychologist has the experience to make this 
worthwhile he may use the clinical method. Often neither 
statistical nor clinical methods are applicable and the 
experimental method may be used if the psychologist feels 
competent to make it worthwhile. 

Choice of tests will be affected by the psychologist's 
orientation and this will often be derived from the orien- 
tation of the department in which he was trained. There 
appears to be a polarization in preferences between the 
simple and quantitative as contrasted with the complex 
and qualitative. In the area of testing for brain damage _ 
the work of Kendrick (1965) and Goldstein and Scheerer 
(1941) illustrates this contrast. Kendrick's data are scores 
on simple tasks. For example in a Digit Copying Test the 
patient is given 120 seconds to copy digits. The score is 
the average time taken to copy one digit. Goldstein and 
Scheerer are interested in the psychological meaningful- 
ness of the qualitative records of behaviour which they 
observe. To achieve this patients are given tests which are 
often open-ended and which provide them with the 
opportunity of giving infinitely varying responses. For 
instance in the Sorting Test Goldstein and Scheerer ob- 
serve a patient's sortings of objects. They record not only 
the finished sortings but also the development of those 
sortings and all the behaviour occurring as well. The mass 
of data collected in this way is in sharp contrast to the 
single score used by Kendrick. : 

Choice of tests will also depend on the kind of evidence 
which is being sought. Sometimes the evidence sought is 
to be acquired by using a well standardized test, which 
will provide scores that can be compared with normative 
data. In this case where an individual's score is to be com- 
pared with the standardization norms, it is imperative 
that the administration should follow the instructions 
laid down in the manual. Any departure from these in- 
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structions means that a direct comparison cannot be 
made. Sometimes it is necessary to depart from the stan- 
dard procedure of administration. Examples of such situa- 
tions are given in chapter 7. When these situations arise 
the psychologist may be willing to forego the advantages 
of comparing his patient's data with the norms available 
in order to acquire other information about the patient 
which does not require such comparison with norms. This 
is a dilemma that frequently occurs. Should he sacrifice 
what may be valuable clinical material in order to geta 
valid score or should he sacrifice the score in order to gain 
the clinical material? Some schools of thought avoid this 
dilemma by insisting on achieving a valid score, even 
when its information value is trivial. Presumably it is felt 
that a valid trivial finding is better than a clinical finding, 
the validity of which is unknown. 

"The psychologist who modifies a test should of course 
be aware that he is adapting the test to his own use, The 
danger arises when he tries to modify test instructions 
and at the same time interpret the resulting data in the 
light of the published norms. He should also be aware 
that his interpretation of data obtained from his modifica- 
tion of the test will require to be validated, 

Practical considerations of time will affect test selection 
in any individual case, For example, in a single out- 
patient assessment session there will be little time to deve- 
lop the experimental approach and the statistical method 
may not be applicable. In selecting tests for clinical 
evaluation the aim is to try to elicit the information that 
is most useful in assessing the case. For example, if it is 
not possible to administer the whole of the W.A.LS. the 
decision as to which subtests to use will be determined by 
an estimate of the relative contribution of the different 
subtests to the assessment problem posed, 

There are a number of tests with Overlapping areas of 
usefulness. In such cases of duplication the customary 
Processes of evolution should eliminate those tests with 
lower reliability, validity, and poorer standardization. For 
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example, the Bernreuter Personality Inventory has been 
superseded by tests such as the 16 P.F. However, many 
tests have special applications and although they overlap 
with other tests it may be necessary to retain them for 
these functions. The Coloured Matrices (Raven, 1958a) 
can be used with a bed patient who is able to do little 
more than point, whereas the constructional and verbal 
tasks of the W.A.I.S. would be inapplicable. 

Many psychologists hold the view that tests should not 
be used which interfere with the development of the re- 
lationship between patient and psychologist. It is possible 
for a psychologist to test a patient with hardly any face 
to face meetings at all. Having formulated a problem from 
the case record and discussions with the psychiatrist he 
may select tests which the patient can do on his own, such 
as questionnaires and inventories, Progressive Matrices or 
Mill Hill Vocabulary. The T.A.T. often proves more use- 
ful when the patient is started off and then allowed to 
continue on his own, writing out his stories himself. 
Whilst these methods may be economical of the psycholo- 
gist’s time there is the danger that he may omit to inter- 
view the patient altogether. 

Testing may influence the patient’s attitude toward the 
psychologist so that for instance a therapeutic relationship 
may be started off on the wrong track. The test situation 
structures the relationship in ways that may be undesir- 
able for therapy. For instance the patient is put in the 
Position of having things demanded of him. He is required 


to submit himself and perform as required by the tester 


who decides what shall be done. This is in contrast to a 
which the therapist 


psychotherapeutic relationship in 
wishes to present himself in a non-authoritarian role. 
Once the patient has acquired a set for testing it may be 
difficult for him to acquire a new set. A similar problem 
arises when a psychiatrist embarks on psychotherapy with 
a patient he has examined physically. The relationship of 
the patient to the therapist is influenced by the physical 


examination. Where the therapist is active and directs the 
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patient, as is generally the case in the various procedures 
associated with ‘behaviour therapy’, then this problem does 
not arise. It only becomes important when the therapist 
plays a fairly passive role. One way round this difficulty is 
to have the patient tested by one person but treated by 
another. 

Test data can be taken as the point of departure in 
psychotherapy. For instance a patient may be asked to 
provide his own interpretations of the T.A.T. stories he 
has told. If this is compared with the tester's analysis, the 
emerging discussion leads on to therapy. 

An extremely important consideration in deciding on 
whether to use a test is one which paradoxically has 
nothing to do with the test. It has to do with the popula- 
tion on which the test is to be used. This is the subject of 
the next chapter. 


di 


6 Base Rates and the 


Usefulness of Tests 


"The base rate is the actual rate of occurrence of a condi- 
tion in a particular setting. For example E. Slater (1965) 
followed up for an average of nine years sixty-one patients 
receiving the diagnosis of ‘hysteria’ and in whom no 
organic condition had been identified as the basis of the 
hysteria. Twenty-eight (46%) of the sixty-one patients 
were subsequently found to have organic conditions which 
would account for the symptoms of hysteria. The base 
rate of organic conditions in patients diagnosed as 
‘hysteria’ in that hospital at that time was therefore 46%. 
The probability of a patient being organic would be 0:46. 
Meehl and Rosen (1955) use the term *antecedent probabi- 
lity' in their discussion of base rates and the use of psycho- 
logical tests. Insurance companies determining the fre- 
quency of occurrence of events such as death, accidents 
and so forth, build their data into expectancy tables. These 
give the base rates or frequencies for these events and are 
used to calculate premiums. 

The interpretation of scores on many psychological tests 
depends on the base rates prevailing in the clinical situa- 
tion in which the test is used. If a test is interpreted in 
ignorance of base rates then use of the test may actually 
cause more incorrect decisions to be made about patients 
than would occur without the test. 

In order to illustrate the vital importance of finding out 
base rates wherever tests are used in clinical practice for 
diagnostic purposes the following hypothetical example is 


given. 
Example 


Suppose a test is devis 
damaged from the non- 


ed for differentiating the brain- 
brain-damaged. In a validation 
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study fifty brain-damaged (B.D.) patients and fifty non- 
brain-damaged patients (N.B.D.) are given the test. The 
base rates are therefore 50% B.D. and 50% N.B.D. A 
cut-off score is found which gives the following results: 


Table r 


"Actual condition 


B.D. N.B.D. 


B.D. 45 5 pB.D. = 0:9 | 
(90% of 50) (10% of 5o) 45 
Test 50 


50 
classi- - 
fication N.B.D. 5 45 pN.B.D. = o9 
(10 % of 50) (90% of 50) (8) 
50 


50 50 N = 100 


I. 90% of all patients are correctly identified by the - 
test (90/100). 
2. 90% of the B.D. patients are correctly identified by 
the test (45/50). ` 
3. 90% of the N.B.D. patients are correctly identified 
by the test (45/50). 
4. Of the cases scoring above the cut-off score 90% are 
in fact B.D. f 
5. From 4 it follows that the probability that a patient j 
who scores above this cut-off score and whom the test calls 
B.D. is in fact B.D. is 0.9. 
6. Of the cases scoring below the cut-off score 90% are 
in fact N.B.D. 
7. From 6 it follows that the probability that a patient 
who scores below the cut-off score and whom the test calls 
N.B.D. is in fact N.B.D. is 0-9. 


Suppose that the test is now used with the same cutting 
score, in a clinical setting where only one Patient in ten 
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referred to the psychologist for assessment of brain dam- 
age is in fact brain-damaged. The base rates are now 10% 
B.D. and 90% N.B.D. This might happen in a neurosis 
unit where the situation could be represented as follows: 


"Table 2 
Actual condition 
B.D. N.B.D. 
B.D. 9 9 pB.D. = 0-5 
(90% of 10) (10% of 90) 9 
Test 18 
classi- 
fication N.B.D. 1 81 pN.B.D. — 0:99 
(10% of 10.) (90% of 90) 81 
82 
10 90 N = 100 


If the psychologist using the test in this situation had 
not considered the change of base rates from the valida- 
tion study to the clinical situation, he would be under the 
impression that the probability of a test positive (cases 
called B.D. by the test) being valid is still o9 whereas in 
fact it has dropped to 0-5. He would also be unaware 
that the probability of a test negative (cases called N.B.D. 


by the test) being valid had risen to 0:99. 
In this clinical situation a score below the cutting score 


could be interpreted with confidence whereas the inter- 
pretation of a score above the cutting score is far from 
Clear. 


Suppose the test is used in another clinical situation 


such as a neurology clinic, where nine out of every ten 
cases are in fact brain damaged. T! he base rates here are 
90% B.D. and 10% N.B.D. With the same cutting score 
the following table shows the effects of the new base rates 


On test results. 
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"Table 3 
"Actual condition 
B.D. N.B.D. 
B.D. 81 I pB.D. = 0:99 
(90% of 90) (10% of 10) 8r 
Test 82 
classi- 
fication N.B.D. , 9 9 pN.B.D. = 0:5 
(10% of 90) (90% of 10) =) 
18 
90 I0 , N = roo 


The probability of a test positive being valid has now 
risen to 0-99 whereas the probability of a test negative 
being valid has dropped to 0-5. Here the meaning of a 
test positive is clear but the meaning of a test negative is 
far from clear. 

In these two examples it is assumed that the psycholo- 
Bist is testing every patient whereas generally he will see 
only a selection of patients. The relevant base-rates now 
are not those applying to the whole clinic. The psycholo- 
gist will only be interested in the referral base rates which 
may well be different from the clinic's base rates. Indeed 


one could go so far as to say that each referring doctor 
will have his own base rates, 


Efficiency of Tests 


` 


The vital importance of considering base rates in assessing 
the usefulness of psychological tests has been shown by | 
Meehl and Rosen to whom reference should be made for 
a more detailed exposition of the problem. They show 
how the efficiency of tests can be evaluated in several 
ways. ; 

Where a dichotic classification is required such as brain- 
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damaged (positive), or not brain-damaged (negative), the 
data can be arranged in a table in this way. 


"Table 4 
Criterion classification 
Positive Negative 
, Test Positive a b a+b 
l Classification Nüüve e a qun 


ate b+d atb+c+d 


x. Efficiency in detecting valid positives is given by 


$ E + 5 This indicates the proportion of test positives which 
are valid. That is to say, the proportion of all those called 
positive by the test who are in fact positive. 


2. Efficiency in detecting valid negatives is give: 
< T This gives the proportion of negatives which are 


valid. That is to say the proportion of all those called 
negative by the test who are in fact negative. 


3. Overall efficiency is given by niter This 
Bives the proportion of the total number of cases which 
are correctly identified by the test. 

The example has shown how efficiencies can change 
when base rates change. In order to maintain a particular 


level of efficiency it will be necessary to consider changing 


cutting scores. In the neurosis unit a higher cutting score 


would be necessary if the efficiency in detecting valid 
Positives is to be kept at 0-9, when base rates drop from 
50% B.D. to 10% BD. Unfortunately this may mean 
that so few cases score above the new cutting score that in 
es uneconomical to use the test. 


| Practice it becom: 


n by 
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To illustrate further the importance of calculating effi- 
ciencies of tests the problem of classifying subnormality is 
presented (Gathercole, 1966b). It is often said that a 
psychiatric diagnosis of subnormality is not to be identi- 
fied with intellectual subnormality, yet many people think 
there is a close correspondence between the two. 

A W.A.LS. LQ. of 70 has been widely regarded 
as the cutting point for intellectual subnormality. The 
example below shows that probably three-quarters of those 
with LQ.s below 70 are able to live independent lives 
without being regarded as psychiatrically subnormal, 

"The calculations are based on three figures: 

(1) an estimated 1% of the total population is psychi- 
atrically subnormal. 

(2) 2:2% of the total population score below I.Q. 70. 

(3) an estimated 60% of psychiatric subnormals score 
below I.Q. 70. 

"This data can be arranged in the usual way as shown in 
table 5. 


Table 5 
Diagnosis 
Subnormal Not subnormal 
69 and below 60% ofi 22—06 
f 22 
W.A.L.S. Sey cH 
TQ: 
7oandabove 40% ofr 978 — 0'4 8 
=04 — = 974 id 
I 99 100 
The efficiency in detecting valid positives| ^ | — o6 
a+b 22 


= 0:27. This means that 27% of test positives are valid 
and consequently 73% are invalid. In other words three- 
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quarters of the people with I.Q.s in the subnormal range 
are not psychiatrically subnormal. 

Where the base rates are known they can be used to 
predict the behaviour of individual patients. For instance 
if eight out of ten psychiatric patients are depressed, one 
could say that the next patient to be seen will be depressed 
and one would be correct eight times out of ten. If a test 
is used to determine this state and the test has an overall 
efficiency of o-7 then more mistakes will be made by using 
the test than by using the base rates. One criterion there- 
fore, of the usefulness of a test is whether it is more or 
less successful than the base rates. If the test is no more 
successful than the base rates then the test should not be 
used, In the example given in the previous section the 
overall efficiency of the test in both the neurosis unit and 
the neurology clinic is no greater than the efficiency of 
the base rates themselves (see tables 2 and 3). If all cases 
are diagnosed as belonging to the majority group the diag- 
nosis will be correct in 90% of cases. If overall efficiency 
is the criterion of the test’s usefulness, 
would be dropped since it adds nothing in 


detection. 
For any given cutting score, the range of base rates, 
over which a test is more efficient than the base rates, can 
graph shown in 


be determined. To illustrate this point the 
figure 1 has been prepared from data on the Memory for 
Designs Test (Graham and Kendall, 1960). If the base 
rate for brain disorder is known then the minimum cut- — 
ting, score which makes the test more efficient than the 
base rates is easily found. 1 
Thus if the Bess rates are 20% B.D. and 80% NBD. 
then the minimum cutting score which can be used is 
three. This gives 18:696 misclassifications. Using the base 
rates alone, one would call every patient non-brain- 
- disordered and be wrong 209, of the time. Using a 
cutting score less than 3 produces more than 2075 mis- 
classifications. For example a cutting score of two gives 


. 21-6 misclassifications. 


therefore, the test 
efficiency of 
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Test Misclassification 


The graph shows that the overall efficiency of the test is 
such that the test should not be used if the base rate of 
non-brain-disordered is less than 25% or greater than 
94%. This does not rule out the use of the test in these 
regions for either detecting valid positives or valid nega- 
tives. All it means is that for detecting both valid positives 
and valid negatives the test is worse than the base rate. 
Clearly if all the patients are called non-brain-disordered, 
all the brain-disordered are misclassified. The misclassifi- 
cation of brain-disordered by the test will be considerably 


less than this. 


Test Misclassifications 


There is always a margin of error in using psychological 


"tests so that some people will be misdiagnosed. Cases 


identified by the test as positive which are in fact negative 
are called false positives. Cases identified as negative by the 
test which are in fact positives are called false negatives. — 
These misclassifications are called ‘misses’. Correctly iden- — 
tified cases are called ‘hits’. — 

In terms of table 4 given above: 


acases are true positives, valid, hits. 
b , ,, false positives, misses. 

C 4, 4 false negatives, misses. 

d , „ true negatives, valid, hits. 


The decision as to what the cutting score for a test 
should be in any particular setting will depend on the 
values attached to the errors made by the test. False 
negatives may prove so costly that it is worthwhile to 
attempt to reduce these at the expense of increasing false 
positives, Thus in testing à patient suspected of an intra- 
cranial tumour, a false positive result is regarded as less — 
harmful than a false negative result. If he is pronounced 


ill when he is well he receives further observation and pos- s 
tions but eventually his 
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well-being becomes apparent and he is discharged. If he is 
pronounced well when he is in fact ill he may be dis- 
charged without further investigation and attention so 
that the consequences in this kind of case may be more 
serious for a false negative than for a false positive. 

It is apparent that values enter into these decisions on 
setting cutting scores. The test user has to weigh the loss 
from accepting a true negative as positive against the loss 
of rejecting a true positive. 


Problems in Detecting Base Rates 


Where the information required to establish the base rates 
for any condition is available in hospital files, the task of 
compiling the necessary data is straightforward, if tedious. 

Unfortunately the data are often not readily available. 
The trouble is that there is no general base rate for the 
whole population which could be used by every tester. 
Each clinical situation has its own base rates, The example 
given above (tables 2 and 3) shows that wide differences 
can occur in base rates between a neurosis unit and a 
neurology clinic. This means that base rates have to be 
established locally. Indeed each psychologist should really 
establish his own personal base rates, 

A further problem is encountered in getting follow-up 
information on patients who have been given psycholo- 
gical tests. Tests are often used in cases where the diag- 
nosis is not clear. In order to find out the base rate of a 
particular condition, cases accepted for testing would have 
to be followed up until a diagnosis had become established, 
This may be as long as two or more years and patients 
may well have left the hospital by that time, Follow-up 
information therefore is very often not readily and rou- 
tinely available and generally is only acquired by setting 
up a special investigation. y 

Another problem arises when cases for which a test is 
used occur infrequently. Where the question of identify- 
ing the presence of brain damage only occurs three or four 
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times a year it is obviously going to take a long time — - 
before an adequate series can be built up. 

Yet another problem is that base rates are often changing 
over time. Thus a particular doctor who frequently refers 
cases to the psychologist for say tests of thinking disorder 
may leave a unit with the effect that the rate of such re- 
ferrals may drop suddenly. Administrative changes may 
take place so that patients of a certain type are channelled 
into another unit. Sometimes a psychologist may be well 
aware that the base rates are changing. At other times the 

changes may be unknown to him. In either case it would 
require continuous checking if changes are to be observed 
properly. This means that a single study to establish the. 
base rates in a particular clinic could not be relied upon at 
a later date if conditions have changed. 

These points show that for many clinical situations it 
is not possible to turn the theoretical developments on 
base rates to practical advantage. If it is possible to deter- 
mine base rates in a particular situation then they should — - 
be determined if tests are to be interpreted properly. The 
difficulties mentioned above show why knowledge of base 
rates is generally rather sparse. 

In the absence of base rates in a particular clinical set- 
ting it may be possible to arrive at an estimate. The litera- 
ture may give a guide. For instance in the cases diagnosed - 
as hysteria and followed up by E. Slater (1965) the propor- — 
tion found ultimately to have been brain damaged at the 
l time of the diagnosis of hysteria was 46%. If a psycholo- 
gist was working in a similar setting he could use this 
figure as a rough guide in estimating the base rate. 

Failing this an estimate may be based on the opinion of 
the psychiatrist at the time he makes the referral. If he 
feels he is making a shot in the dark he is more likely to 
miss than to hit, so the base rate for such a condition 
would be estimated at less than say 30%. If he has a strong 
suspicion about a case then the estimate for the base rate 
would be put at greater than say 70% on the assumption 
] that the psychiatrist is more likely to be right than wrong. 
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This of course would be a rather hazardous procedure 
but it should be remembered that without some estimate 
of base rates a diagnostic test should not be used at all. 

Meehl and Rosen (1955) give a formula for determining 
what the base rates would have to be for a positive diag- 
nostic assertion from the test to be more likely true than 
false. 


Py ha 


OQ hh 


Where pı is the percentage of actual positives called 

postive by the test 

p: is the percentage of actual negatives called positive by 
the test 

P is the base rate (percentage of total) of the actual posi- 
tives 

Q is the base rate (percentage of total) of the actual nega- 
tives (100-P). 


The following example illustrating the use of this formula 
is taken from Meehl and Rosen (1955). 

Piotrowski has presented a set of ten Rorschach signs 
of brain damage. He suggested that if five or more of the 
ten signs are present in a patient’s Rorschach record then 
he is probably brain damaged. A cross-validation study 
by Dorken and Kral found 63% of organic and 30% of 
a group of non-organic psychiatric patients had Rorschach 
records with five or more of Piotrowski’s signs. 

Thus 
Pa _ 030 _ 
Pr 063 
and for the conclusion that brain damage is present to 


0:48 


be correct more than half the time Es must be greater 


than 0:48. From this P is found to be 0:33. That is, the 
percentage of actual brain-damaged patients in the popu- 
lation concerned has to be greater than 33% for the effi- 
ciency of the test in detecting valid positives to be at 
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least 0-5. If the rate of brain damage is lower than 
this then test positives will be more often wrong than 
right. 


Attaching Probabilities to Test Scores 


Because there is always a margin of error in drawing 
inferences from test scores it is important to know what is 
the probability of a particular test indication being correct. 
This will show how fallible the test's diagnosis is in each 
individual case. 

If a cutting score is used in a test the probability of any 
single score being correct is given as that for the particular 
half of the range in which it happens to be (that is, above 
or below the cutting score). Thus the probability associ- 
ated with a score just below the cutting score is just the 
same as the probability associated with the lowest score of 
all For clinical purposes therefore the use of cutting 
scores is often inappropriate. It is usually far more useful 
to discover the probabilities attaching to each score. This 
has to be done for a whole range of base rates. 

The following graph show this for the Memory for 
Designs Test (Graham and Kendall, 1960). It was con- 
structed from the cumulative percentages for both con- 
trol and brain-disordered groups available in the manual 
for this test, From these percentages it is possible to 
calculate the percentages of each group making each score. 
Thus there are 0-5% controls with difference scores of ten 
or eleven whereas there are 11-175 brain-disordéred pati- 
ents scoring in this score interval. The probability of 
a score being valid positive can then be determined for 
any given base rate. Thus for base rates of 10% brain- 


disordered and 90% controls. 


11:154 of 10 
P = Gray, of 10) + (0:54 of 90) 


= 071 
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‘The statement can then be made that in a situation where 
only 10% of patients referred for assessment of impair- 
ment consistent with brain damage are in fact brain- 
damaged, a patient scoring ten or eleven has a probability 
of 0-7 of being brain-damaged. This means that seven out 
of ten patients scoring ten or eleven would in fact be 
brain-damaged. 

This graph turns out to be very instructive. Taking the 
base rate of 10% brain-damaged it is seen that a patient 
has to score at least sixteen before one becomes fairly 
| certain of his being brain-damaged. All the scores from 
' fifteen down to seven, which are all above the official 
| cutting score, give probabilities of brain disorder ranging 
| from about 0-2 to 0-7. Obviously it would be best to call 

scores indeterminate in this region of probabilities. 
| Graham and Kendall, recognizing that users of the test 
| may wish to calculate probabilities and cutting scores for 
| themselves, provide cumulative percentages for this pur- 
| pose. It is hoped that in future all test constructors will 
provide such data for this purpose. 
| If probability curves are based on a small standardiza- 
tion sample then cross-validation is likely to produce 
rather different curves because of sampling errors. In order 
that the curves should be stable on cross-validation, large 
numbers of subjects must be tested. Even though Graham 
and Kendall used 243 brain-disordered and 535 control 
subjects, there were fluctuations in the curves plotted for 
each individual M.F.D. score. To smooth out these bumps 
a score interval of two has been used, yet an unexpected 
dip occurs between scores 10/11 and 16/17. One would 
expect that as the score rises the probability of brain 


dip may be due to inadequate sampling, in which case 
larger numbers are required to give a more accurate indi- 
cation of where the curves lie. It may, however, be a 
genuine dip and if so it illustrates the need for plotting 
probabilities of actual-scores rather than relying on cut- 


disorder would rise also. In fact as the score rises from | 
ten to fifteen the probability of brain disorder falls. This 


C 
2 
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ting scores. If cutting scores were relied on this dip would 
not have come to light. 

What level of probability should be taken as indicating 
brain damage? Some suggest 0-95 in line with statistical 
usage. Thus one would be wrong once in twenty cases 
and this would be taken as too infrequent to be a chance 
Occurrence. When the consequences of the decision are 
considered, however, it is clear that 0:95 is much too rigor- 
ous a level. Although the number, of false positives may 
be small the number of false negatives (the more serious 
error) will be large. Even with o-5 a psychiatrist may feel 
justified in calling for further investigations because he 
does not wish to make the error of calling a patient well 
when he is in fact ill. If psychiatrists accepted the use of 
probabilities attached to test scores this would be more 
useful to them than the sort of statements psychologists 
tend to make in their reports such as: ‘The patient 
scored eight on the M.F.D. Such a score is most fre- 


quently found in patients who have suffered brain dis- 
order.' 


7 Assessment Technique 


Introduction 


Despite the guidance provided in test manuals on admini- 
stration procedure and the instructions to be given to 
patients, the psychologist has to learn from experience 
how to deal with many problems which arise in practice, 
"This chapter is presented to point out some of these prob- 
lems. 

The eliciting of information from patients, which is the 
basis of psychological assessment, requires considerable 
skill and knowledge. Where testers are unskilled the con- 
sequences for both clinical and research work may be seri- — ^ 
ous. In clinical work concerned with diagnosis, selection 
for treatment, follow-up of treatment results and voca- 
tional guidance the patient may not be helped in the best ' 
and most appropriate way. In research, the data may be 
incomplete if the required information cannot be elicited. 
Statistical compromises then have to be made to handle 
the incomplete data. 

Experimental groups may be biased if some patients 
selected for study do not cooperate. This could happen, 
for instance, where psychopaths are being asked to under- 
go the Sedation Threshold Test (Claridge and Herrington, 
1963) which involves venipuncture. Often these patients 
see no personal advantage in cooperating and refuse to do 
the test. Such drop-outs may seriously bias the group * 
results. It is likely that the notorious difficulty in repeating — 
experimental results in psychology and psychiatry is often 
due to differences in the level of skill of different re- 
searchers, some losing patients and data which more __ 
skilled experimenters can retain. E 

When the variables that may affect performance in 1 
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psychological tests are recognized then some attempt can 
be made to control them. More valid data will be obtained 
if due regard is paid to the complexities of behaviour 
instead of oversimplifying test situations. 

A person only becomes a skilled tester with practice. 
Experience is necessary before he can decide what is the 
best way to handle any particular situation. Sometimes 
one approach is appropriate whereas at other times, given 
what appears in many respects to be the same situation, 
the exact opposite approach is called for. 

This view does not imply the creation of a mystique 


^ around testing nor that psychologists should be the only 


ones allowed to use tests. Demarcation disputes are alien 
to the spirit of the behavioural sciences, but all who use 
tests must be aware of their responsibility to acquaint 
themselves with the problems which testing involves. 


Preliminaries and Introduction of the Patient to 
the Test Situation 


Patients’ attitudes to testing 


When a patient comes to be interviewed by a psychologist 
he brings with him a set of attitudes and expectations 
derived from a variety of sources: from newspapers and 
T.V., from other patients, from nursing and medical staff 
and from his own previous experience. 

One influence on patients’ attitudes which is difficult to 
assess is the contact with other patients on the ward who 
have seen the psychologist. They undoubtedly discuss the 
procedures they undergo but ignorance of the effect of 
this contact tends to be rationalized by assuming it to be 
negligible. 

"The way in which he is told he is to see the psychologist 
will also influence a patient's attitudes, He may be in- 
formed by the psychiatrist, by a nurse or by the psychol- 
ogist himself but whoever makes this communication can 
affect the patient's degree of cooperation and ego-involve- 
ment in testing. If he has not been prepared at all he may 
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wonder who the psychologist is and even whether he is 
a member of the hospital staff. On the other hand, if he 
sees the psychologist about the ward each day and knows 
that other patients visit him, he may also expect to visit 
him and even feel left out of things if he does not. 

Usually the doctor dealing with the patient will tell him 
that he will arrange for him to be seen by the psychologist. 
In doing this a doctor may convey the impression that the 
psychologist has magical powers and invest him with an 
aura of omnipotence. Generally though the doctor will 
make the referral in a matter of fact way as though the 
patient were to go and see the optician or have an x-ray. 

When a patient comes to hospital he may expect to see 
a number of people who will question him. By the time he 
has seen the doctor at the out-patient clinic, the admitting 
doctor, a registrar who will handle his case, a consultant 
and a social worker, seeing the psychologist is just another 
in a long series of interviews. He may by this time be 
getting resistant to further interviewers or he may be 
warming to his role as a patient. 


Preliminaries to testing 

Before seeing a patient a psychologist will generally seek 
some information about him and his present condition 
from the doctor and nursing staff. They may be discourag- 
ing, for instance, in suggesting that ‘you won't get any- 
thing out of him.’ Indeed a doctor may misguidedly 
refrain from referring a patient because he is regarded as 
being in an untestable state. Usually one should not be 
reluctant to test a patient before actually making the 
attempt. It is often surprising how much cooperation can 
be achieved with attention to technique and some persis- 
tence. 

The next stage in the procedure is to make sure that the 
patient fulfils the conditions required by the test situation, 
for example that he has glasses when he is required to read, 
that he is not stone deaf or that he has his hearing aid 
tuned when he is required to listen to a tone used to 
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elicit a G.S.R., or that he is not colour blind if this is 
relevant. 

Before testing it is necessary to establish a relationship 
which is conducive to the obtaining of the information 
required. A brief chat on the ward before the patient 
comes to the office may help. When he comes for inter- 
view a short conversation acclimatizes him and prepares 
his mental set for testing. Good rapport is not essential, 
although usually helpful. As long as he is ready to do what 
is asked there is no need to spend excessive time in 
developing a relationship. 

In this conversation it is often worthwhile rapidly going 
over the patient's present condition and recent history so 
that the testing can be related to these. For instance, he 
might be asked how he is feeling, what does he feel is 
wrong with him, in what way does he feel he has changed, 
why has he come into hospital? 


Introduction to testing 


Having established contact in this way the testing can 
then be introduced. Sometimes there is no need to give 
any reason for this. One may merely say, ‘I have some 
questions I'd like to ask you’ (or ‘tests I'd like you to do’), 
If this is said in a positive manner, assuming an attitude 
indicating that he is expected to cooperate then the 
patient is usually carried along without thought of object- 
ing. At other times he may be prepared to admit, for 
instance, that his concentration is poor. Most psychiatric 
patients will confess that they are not able to concentrate 
as well as they used to. It is then but a short step to 
introduce the tests in order to see how he is concentrating. 
Depending on the tests to be given, one may get the 
patient to admit that his emotions sometimes get the 
better of him or his memory is poor or he finds it difficult 
to relax. The tests are then introduced as ‘helping us to. 
understand these difficulties better. Even if he does 
not admit to such problems, or perhaps feels he has; 
recovered from them, one can often carry on regardless 
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by saying ‘well we want to see how your memory [etc.] is 
now." 

In giving reasons to the patient for the necessity of 
testing one should be as truthful as possible, having regard 
to the patient's level of understanding. However, complete 
truthfulness may cause unnecessary suffering to the patient 
or make him reluctant to do the test. There could be 
little justification for saying to an intelligent professional 
worker, ‘You are being tested so that we can assess the 
degree and quality of your intellectual deterioration in 
order to distinguish between the differential diagnoses of 
organic brain disease and schizophrenia. One has to con- 
sider seriously, however, how far a patient should be mis- 
led concerning the reasons for testing. For example, in 
using projective techniques to assess emotional adjust- 
ment, to elicit conflicts and interpersonal attitudes it is 
questionable whether a patient should be led to believe his 
imaginative ability is being tested. 

If the assessment is part of a research project there is the 
problem of asking his permission to carry out the proce- 
dures. Often there seems little point in doing this with 
psychological tests which are used in clinical work any- 
way. It is then probably best for the patient to regard the 
testing as part of the day-to-day clinical work. This is 
particularly true where it is eventually intended to use 
tests for clinical work. If they are developed under con- 
ditions different from those in which they are to be used in 
practice there may be important differences in results. 
For instance, in using G.S.R. habituation to assess anxiety. 
(Lader and Wing, 1964) a patient may give differing 
results according to whether he is persuaded that he is 
doing the test to help the psychologist in his research or 
whether he feels his own future might depend on the 
outcome of the test. Where medical procedures are being 
carried out, as in the Sedation Threshold Test, permission 
has to be obtained from the patient, or if he is psychotic 
from a relative. 

In this brief introductory period the psychologist has 
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to gauge the patient's attitudes towards the interview and 
towards the psychologist. He may have to try to alter 
those attitudes so as to achieve a sufficient degree of 
cooperation from the patient in order to get the informa- 
tion he is seeking from the interview. 


Persuading Patients to Cooperate 


Most patients will cooperate in doing the various tasks 
that psychologists ask them to do. This follows partly 
from their curiosity and partly from the tradition. of 
respect for authority figures. By his skill the psychologist 
attempts to develop a relationship and provide a situation 
in which the patient feels sufficiently at ease and secure to 
produce the information required. But some patients will 
object and the psychologist frequently has to deal with 
suspicion, fear and hostility before he can get such patients 
to cooperate. x 

There are various reasons why a patient may be unwill- 
ing to be tested. He may consider his condition to be 
physical and not mental. Therefore he cannot see the 
relevance of psychological tests. He may feel perfectly 
well and object to testing because this implies he is ill. 
He may think that the test results will be used to show 
that he is mad so that he can be locked up in hospital for 
the rest of his life. 

A patient may refuse to see the psychologist when asked 
to do so by a nurse. The psychologist would then have to 
see the patient personally in the ward to tell him he would 
like to have a chat. Often this is sufficient and the patient 
comes willingly. After arriving at the interview and having — 
been persuaded to talk about himself the tests can be - 
introduced as a matter of course, 

If he does not come he can be asked, ‘What is the diffi- 
culty — what is worrying you — is there something on - 
your mind?' He may mention fears about the interview 
and it may be fairly easy to relieve him of these. Suspicion 
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and hostility can be allayed sometimes by reassurance and 
explanation. He can be told that the interview is for his 
own good and that it is necessary if he is to be helped. It 
may help to indicate that other patients also complete 
these tests. There are times when it is appropriate to 
ignore objections, gently taking the patient's arm and 
guiding him to the interviewing room insisting cheerfully 
that he really wants to come. Under such bustling encour- 
agement many patients will not put up further opposi- 
tion. 

On the whole physical force should be avoided but there 
are occasions when it should be considered. For example, a 
restless hebephrenic girl who did a jig during testing 
rushed out of the room impulsively at one stage. When 
marched back again she was not in the least perturbed. 
There are occasions, however, when such action would be 
sheer folly. Everything depends on the mental state of the 
patient. It is probably advisable to leave these situations 
to the nursing staff who will often know best how to deal 
with a particular patient. Sometimes such a spontaneous 
interruption of the testing session is the means whereby 
the patient discharges his restlessness. It is then better to 
allow the patient who may have walked out of the room 
to pace up and down for a while before inviting him to 
start again. With chronic schizophrenic patients this is 
often all that is required. 

Enthusiasm for getting the patient to cooperate carries 
the danger of illegitimate and unethical procedures, such 
as threats of withdrawal of privileges. It would be wrong 
to imply that discharge from hospital is dependent on 
cooperation. It is better to admit defeat rather than resort 
to such procedures. At such a time the nursing staff, the 
doctor or the patient’s relatives may have suggestions for 
persuading the patient to cooperate. Alternatively a later 
opportunity may be taken to try again. 
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Testing Technique 


In presenting test items a tester should take a positive 
attitude. This makes it difficult for the patient to refuse. 
It is better to say ‘I want you to try this one now’, rather 
than ‘Would you mind doing this test?’ 


Checking the patient’s understanding of instructions 


Having secured his attention and cooperation the patient 
is given the test instructions so that he knows what he has 
to do. It is essential that his understanding of the instruc- 
tions be checked. For example, in administering Piaget’s 
tests of conservation (Inhelder and Piaget, 1958) to schizo- 
phrenic patients some patients will answer without really 
understanding what is asked. They may answer ‘Yes’ to 
every question. Thus, if shown a ball and a sausage, each 
made of the same amount of plasticine, and asked which 
has the more Plasticine, the patient’s answers can be 
checked by pointing to the ball and saying ‘Is there more 
in this one than in this one?’ To check again the sausage 
is indicated first and the question repeated, If he answers 
‘yes’ to both questions he has evidently not really under- 
stood what is required of him. 

In a distraction test the procedure is to present the task 
without distraction and then with distraction (Chapman 
and McGhie, 1962). It is not sufficient to tell him what he 
has to do in the condition of no distraction, however 
simple the task. One has to check that he really can do it 
and that he knows what is required. This will necessitate 
a preliminary trial run through and possibly repetition of 
the instructions or even a demonstration, 

The use of gestures and miming is often useful in order 
to show a patient what is required, For example, in get- 
ting a senile patient with dementia to copy the Bender 
Gestalt Figures (Bender, 1938) one often has to place the 
pencil in his hand and guide it to the Paper. When he 
wonders what he has to draw, the card in front of him is 
indicated. If he starts to draw on the design his hand has 
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to be moved to the paper. By pointing to the card and 
the paper he is eventually brought to understand that he 
has to copy the design on the card on to the paper. 


Procedure 


In administering any test, of course, one should start 
out with the intention of adhering to the standard instruc- 
tions given in the manual. However, there are frequent 
Occasions when the standard procedure must be modified. 
For instance, a depressed patient who is retarded may 
take a long time over the Block Design Subtest of the 
W.A.LS. (Wechsler, 1955). If he goes over the time limit 
it often pays to let him continue in order to see how much 
he can achieve when given unlimited time. This may be 
important where there is a question of organic involve- 
ment. The organic patient may also be retarded but may 


be expected to make errors however much time he is’ 


allowed. 


A procedural modification which should only be used - 


as a last resort is for the examiner to do a bit of a test 
which the patient will not begin. A patient may even say 
to the examiner ‘Td like to see you do it’ when shown the 
T.A.T. cards. The only way to get such a patient to do 
the test may be for the examiner to make a start. This can 
happen with aphasic patients who are asked to say the 
alphabet. They may not be capable of starting until the 
first few letters have been said for them, 

Sometimes it is not very clear whether a patient has 
finished doing a test such as the W.A.I.S. Block Design. 
It is then necessary to ask, ‘Have you finished that one?’ 
to find out whether he is still considering it or whether he 


is waiting for the next one. If he is not too sure about his _ 


production, this question may be taken by him as confir- 
mation of his suspicion that he has not quite got it right. 
This apparently neutral question might, therefore, be 
taken by the patient as prompting. The tester must con- 
sider whatever he says and does very carefully to determine 
whether it constitutes prompting. 
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Prompting, reassurance and encouragement 


Illegitimate hints may be given quite unwittingly by the 
tester as, for instance, in repeating digits. If the tester 
winces when he hears a wrong digit, the patient may be 


able to correct himself. Even nodding or saying ‘Aha’ to 


acknowledge the answers to Progressive Matrices (Raven, 
1960) problems may be taken by a patient as indicating 
that his solution was correct. If his solution was based on 
a position response he may then repeat that position 
response for all the other problems, probably receiving 
confirmation of the correctness of the choice by a nod of 
the examiner’s head, 

When a patient asks for reassurance the tester should 
answer as non-committally as possible, but in such a way 
as to retain his interest and cooperation. If the patient 
asks, ‘Should I do it this way?’ the tester might repeat 
part of the instructions. In the Bender Gestalt, for ex- 
ample, he would be told to copy what he:sees on the card. 
Or he might be told that he is to do it in his own way 
or that he is to decide himself, ` 

Frequently patients ask ‘Is that right?’ In answering 
this question the examiner must refuse to inform the- 
patient of the accuracy of his responses, but in such a way 
that his effort and interest will be maintained, When the 
response is made, however, and recorded, one may indicate 
Whether it was correct or not. This can often be avoided 
by saying he is doing well. There is little point in saying 
he got an item right which, in fact, was wrong. If he 
realizes it was wrong he may not appreciate your attempts 
to jolly him along misleadingly. A better solution is to say; 
"Well no, you didn't get that one, Have a go at the next 
one.’ Honesty in this situation is often more likely to 


increase trust and cooperation than trying to cover up — 


the patient's failures. If he realizes he is failing and. 
appears to be discouraged he may well be told, ‘Well they 
are meant to be difficult you know. You are not expected. 
to get them all right.’ Sometimes patients ask what is the i 
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correct answer. For example, many patients are curious to 
know what the objects in the W.A.I.S. Object Assembly 
are. Sometimes it does no harm to tell them, but if a 
patient is to be retested later the question should be 


parried because the knowledge may help him on retesting. - 


Patients often say ‘I can’t do it.’ One answer to this 
is ‘Do what you can, try it anyway.’ Another way of 
answering is to be more forceful by insisting, “Yes, you 
can do it, now tell me some more.’ This would be the 
approach in the Object Classification Test (Payne, 1962) 
in which the patient has to be encouraged to continue 
sorting the first time he gives up. In testing for persevera- 
tion one test requires the patient to name all the animals 
he can think of (Freeman and Gathercole, 1966). When 
he gives up he should be vigorously encouraged to con- 
tinue. Sometimes an item cannot be repeated, as in 
memory tests such as digit span, and if the patient says 
he cannot do it he can be told, ‘never mind, try the next 
one.’ In some tests he can be told to have a guess if he 
cannot do an item, as in the Progressive Matrices. Natur- 
ally it does not pay off to insist on the patient guessing 
if he feels strongly that he can only give answers that 
he is sure of. Many patients are affronted when asked to 
guess and if pressed too hard may refuse to finish the 


test. 


Test order 

When several tests are to be administered to a patient, the 
order in which they are given should be carefully con- 
sidered because responses to later tests may be affected by 
earlier ones. This has been shown when several question- 
naires have been given to patients (Furneaux and Lindahl, 
1963). It is obviously necessary to give a test of G.S.R. 


habituation before a distraction test when auditory stimuli — 


are used for both the G.S.R. and the distraction test. In 
correlating performance on the Epstein Test (1953) of | 
‘overinclusive’ thinking with a measure of intelligence — 


such as in the Shipley Hartford or the Synonyms of the | - 


a 


120 


Assessment Technique 


Mill Hill Vocabulary (Raven, 1958b) there may be differ- 
ent results according to whether the Epstein is given 
before or after the intelligence tests. The reason is that in 
all three tests the subject has to select words which have 
to be underlined. The set for the Epstein Test acquired 
during the Mill Hill Vocabulary might be quite different 
from the set adopted without such prior experience. An- 
other situation where order of administration is important 
is in testing for perseveration. If writing tests are given 
before drawing tests, the patient may continue to write 
when asked to draw. 


‘The Influence of Patient Variables 


In using psychological tests for assessing mentally dis- 
Ordered patients an examiner must be fully acquainted 
with psychiatric Symptomatology in order to deal with 
the special problems of testing which they pose. 


Anxiety 


One of the main sources of interference with testing is 
anxiety. Sometimes a patient will tell you what is making 
him anxious. Sometimes he has to be asked. Occasionally 
one may be able to bring a worry to the surface for ventila- 
tion by verbalizing it for the patient in the same way as 
the psychoanalyst makes interpretations in Psychotherapy. 
Such interpretations are sometimes right and appropriate 
and they result in considerable relief for the patient. 
Sometimes this does not happen and one has to be careful 
in presenting them so that the Patient is not further alien- 
ated should the interpretation be inappropriate. 

A common fear is of authority figures. Another is of 
ridicule and loss of approval if he fails to perform as he 
thinks he should. This fear may be increased when a stop 
watch is waved in front of him and he gets flustered as a 
result. Denial of loss of abilities sometimes occurs in 
brain damaged professional People and then the patient 
may not wish to be faced with his impairment, There may 
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be sexual fears, as in a woman who became very tense 
when sitting at a table to do distraction tests whilst the 
tester stood behind her giving her the instructions. She 
became so distressed that she could not do the test and 
could not speak to explain her distress. Later it was found 
that she had been very upset in a crowded shop when a 
man had pressed up against her from behind and in the 
crush she had not been able to escape. 

Some patients are afraid of being tested from their 
fear of going insane. The fact that they are being given 


tests which they think are used for mad people indicates i 


to them that they are being considered mad. 

There are innumerable delusional fears which can never 
be guessed at. For example, one woman was unable to 
press the key in a reaction time experiment because she 
thought she might thereby be torturing and killing her 
husband. In schizophrenic patients the disorder of iden- 
tity and ego boundaries may be a source of distress. Many 
schizophrenic patients were reluctant to put on head- 
phones in a room where a tape recorder was plain to see 


; because they feared that their thoughts could be recorded 
on the tape. Some schizophrenic patients suffer from 
acute anxiety which may not have any special content. ` 
During this phase they may not be able to say what they - 


are afraid of. 
Patients are often afraid of what is going to happen to 


them. They may expect to die or be tortured or suffer in ia 


some way. This fear was raised by many patients coming 
to the psychologist's room which was in a unit of the hos- 


pital known as "The Treatment Centre’, where E.C.T, - " 
was given. A patient who had heard of E.C.T. and knewit | 


was given in the Treatment Centre would understandably 


be worried if asked to place his hand on a metal plate . 
with impressive wire connexions and electrical gadgetry | 


attached. Then to place on his head headphones, which 
are very similar to the E.C.T. electrodes, is too much. 
This situation takes a lot of explaining to reassure fearful 
patients that all will be well. Some patients, usually those 
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who are not afraid, are most grateful after this G.S.R. 
test, saying how much better they feel after the treat- 
ment! 

‘Ideally one should use two rooms for such assessment 
procedures; the one for the patient being a pleasant, car- 
peted, soothing room, and the other next door housing all 
the equipment which can provoke such distress. 

To relieve anxieties about what will happen the 
examiner should give a straightforward account of what 
will be done and what will happen to the patient, Even 
then there will be patients who are sceptical. After all, 
who can expect a psychologist to be honest and above- 
board when one has heard stories of experimental 
subjects who are tipped out of chairs without warning, 
who endure unexpected loud noises (Landis and Hunt,. 
1939) and who are led to think the Psychologist is in- 
terested in one aspect of their behaviour when really he is 
interested in another (Bramel, 1962). It sometimes takes a 
lot of talking to convince Patients you are a ‘straight’ 
Psychologist. 

There is a danger in over-explaining whilst attempting 
to reassure patients, that anxieties may be evoked which 
were not previously present. For instance, if whilst attach- 
ing G.S.R. electrodes a Patient is assured confidently that 
he will not get a shock from this, the tester may be plant- 
ing an idea that had not occurred to him. He is then more 
worried after reassurance than before. 


Depression and elation 


Apart from anxiety there are other disturbances of affect 
which have their influence on testing. Weeping and self- 
criticism frequently occur and usually call for sympathe- 
tic support. The euphoric patient may feel that there is no 
need for him to try and make an effort. The grandiose 
patient may regard the interview as an insult, particularly 
if he has a condition such as affect- 
He may be humoured if the examine: 
his delusional position. 


laden paraphrenia. 
r pays deference to 
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Aggression 


In general, verbal aggression can be ignored and testing 
can be continued without getting involved in an argument 
with the patient. 

The patient who criticizes may be deliberately trying to - 
provoke the examiner to anger. On the other hand, the | 
schizophrenic who threatens to write to the authorities . 
about the examiner's behaviour may merely be discharging 
emotion. 

One way in which some patients may be made angry is 
by giving them tests which are ridiculously easy. In a 
study of the impairment of switching type of persevera- _ 
tion (Freeman and Gathercole, 1966); senile patients were 
asked first of all to count from one to ten and then to say - 
the alphabet. It was not surprising that a number of them 
objected to being treated like children. However, when 
these two tasks are given after a number of more challeng- - 
ing ones in which patients have been engrossed, then very — 
few will object to the easy ones, merely because they have 
become set for doing tasks. 

With a patient who objects to the childish nature of the 
tests it may be worthwhile presenting a task he finds diffi- 
cult. For instance, a patient who was given several psy- 
chomotor tasks objected to the peg-board as being | 
infantile and it was only when he was given a complicated 
pencil maze to do with his non-dominant hand whilst 
viewing through a mirror, that be felt he was being treated 
like an adult. & 

When a patient objects to tests which he feels are more 
appropriate for babies, this may be a defensive manoeuvre — 
examiner should be careful abo 
rder to show hi 


that they are 
will probably be afraid of the 
threat to his self-esteem if he should fail. 
If a brain-damaged patient feels he is failing or that à r 
problem is too difficult for him a catastrophic reaction. 
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may be precipitated (Goldstein, 1959). Apart from irrita- 
bility, anger and refusal to cooperate further there may 
be a reduction in the level of consciousness. 


Attention 


In addition to the basic necessity of getting the patient to 
cooperate and do the tests, another basic requirement is 
that his attention should be retained in order to com- 
plete them. Since defects of attention are very common 
in psychiatric patients obviously the examiner has to give 
special consideration to these in order to determine in 
what way they are affecting test performance, , 

Confusion and perplexity are often features of psycho- 
sis, whether functional, organic or even drug-induced as 
by L.S.D. It is possible to increase this confusion if there 
are too many people questioning the patient at any one 
time. This can happen when a patient is being seen in bed 
and the nurse in attendance is trying to be helpful. She 
may repeat the question asked of the patient in an effort 
to get him to understand. Frequently this merely serves 
to confuse him all the more because he has to keep re- 
directing his attention to different sources of information. 
In such a case it is better for one person to do the ques- 
tioning and encouraging. y 

Often psychotic patients are preoccupied or withdrawn 
and have to be alerted to external communications. One 
schizophrenic girl being given the W.A.LS. vocabulary 
subtest answered with words concerning her delusions 
such as God, spirit, sky, etc. The whole list of words was 
presented a second time in a loud and staccato manner 
with a bang on the table to emphasis each question. This 
procedure enabled her to give quite rational and appro- 
priate replies. 

Distractibility and perseveration are symptoms of dis- 
Ordered attention which may interfere with testing and 
require special precautions for minimizing the interfer- 
ence. Distractions such as sounds outside the room and 
visual heterogeneity inside the room can be reduced. Then. 
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if the examiner is not restless and manages to keep still 
this helps the patient to attend to what he is saying. By giv- 
ing instructions or asking questions slowly so that the 
patient has time to take in what is being said his chances . 
of understanding are improved (Chapman and McGhie, 
1963). 

In dealing with perseveration of the impairment of 
switching variety the examiner should allow time between 
tests or questions and consider the order of presentation 
since some responses are more likely to perseverate than 
others. 

In both perseveration and distractibility it is necessary 
to keep stimulus material out of sight. For example, in 
visual memory tests, the stimulus designs may have to be 
completely removed from sight and his previous produc- 
tions also. Even other shapes and drawings which might 
be on the examiner's desk at the time should be carefully 
covered. 

"The first signs of fatigue in testing are usually irritability 
and disorders of attention. The examiner constantly has - 
to be alert for these signs so that the patient may be given 
arest or a change of task, Children and patients with — 
organic cerebral disorder are probably most prone to 
fatigue but very often these patients are able to carry on 
for up to two hours without fatigue. Assessment should 
not therefore be ended prematurely, particularly where 
limited time is available as in out-patient consultations. 2 
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the tester which will influence 


There are many aspects of 
be tested and his attitude to 


the patient’s willingness to 


the tests. ae a 
Appearance, sex, age, colour, accent, nationality are | 


probably in themselves of lesser importance. Of greater — 
importance are his adaptability, skill, tact, ability to em- 
pathize and his human interest in the patients he — 
examines. As in any aspect of work with psychiatric Y 
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patients he needs to have an understanding of his own 

; personality functioning. This is necessary if his assessment 
of what happens in the relationship with the patient is to 
be as free from bias and distortion as possible. 

Hë should be constantly on the look out for the effects 
of his actions and words on the patient being interviewed. 
Signs of impatience and boredom, such as yawning or 
looking at one’s watch, are often taken by patients more 
seriously than we think. For example, one patient said 
when the examiner yawned, ‘You must be tired — tired of 
this work, tired of patients, tired of me.’ 

Patients will often bring to the testing situation atti- 
tudes carried over from other situations in their lives such 
as attitudes towards members of the family or to other 
members of the hospital staff. The psychologist therefore 
may not be treated as a person in his own right but as a 
representative of a class of people for that patient. This 
was apparent in the case of the patient with the sexual 
fears described above. 

Although the psychologist cannot always know the 
origins of such attitudes within the test situation he 
should be aware that.they occur and be prepared to 
handle them when he recognizes them, 

The biasing influence of testers on results of experi- 
ments has been examined recently rather more than in the 
past. The various biases that can occur have been called 
‘the experimenter effect’. One aspect of this effect is the 
personality of the tester. Another is his attitude or orien- 
tation to the results of the experiment or test. 


Outcome orientation 


A tester can bias a patient's behaviour and responses to 
tests as a consequence of his expectations of the way the 
patient should behave. ‘One Prophesies an event and the 
expectation of the event then changes the prophet's be- 
haviour in such a way as to make the predicted event 
more likely’ (Rosenthal, 1964, p. 405). This is the self- 
fulfilling prophecy. The behaviour of the tester in some 
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way alters the subject's responses to fit in with the be- 
haviour expected. Testers are often not as impartial as 
they would like to think of themselves. They often have a 
personal orientation to the outcome of their tests and the 
results may give rise to varying emotions depending on 
whether the tester's expectations and wishes are fulfilled or 
not. 

The explanation of the effect of the tester's outcome 
orientation probably lies in the unintentional transmission 
Of sensory cues from tester to patient. There was a re- 
markable horse called Clever Hans, which could count by 
tapping his hoof on the ground and perform various 
other remarkable tasks. It was found that he was using 
visual cues transmitted by his questioners. A person ask- 
ing Hans to count would incline his head forwards when 
he expected him to begin counting. When he expected 
Hans to stop, a questioner would slightly raise his head or 
eyebrows. 

In studies where subjects are handled by their experi- 
menters tactile and kinaesthetic cues are probably im- 
portant, Rats which were actually selected randomly but 
said to be rather good at running mazes (maze bright) 
were found by their experimenters to be maze bright. Rats 
said to be maze dull (but also in fact randomly selected) 
were found to be maze dull. The performance of these 
rats in the maze was in some way affected by their experi- 


Menters’ expectations. 
In clinical testing patients receive abundant cues both 
judge their tester’s 


visual and auditory from which to D 
expectations. The tone of voice, inflexion and the whole 
manner of speaking of the tester conveys à lot about his 

Apart from con- 


attitude to the patient's responses. 
sciously directing the patient's responses he may ver- 
bally condition them unin 
that it is possible to increase the subject's use of plural 
nouns by saying ‘mm-hmm’ whenever such words are used 
by the subject. This effect can even occur ina multiple 
choice test such as the Progressive Matrices. A patient 
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quickly developed a position effect, always selecting the 
item in the bottom left-hand corner, as a result of the 
author's saying ‘mm-hmm’ when the patient gave each 
answer. Obviously such conditioning could affect pro- 
jective test responses as well. Choice of T.A.T. content 
might well be affected by the reinforcement provided by 
the tester. 

Visual cues are provided by a tester's facial expression, 
his gestures and general bodily disposition. 

"There must be individual differences in the extent to 
which different people are able to pick up auditory and 
visual cues. It may be that some subjects are so insensitive 
that whatever the tester does to indicate his orientation to 
the outcome of the tests has no effect on their results. 
Other subjects may be hypersensitive so that they respond 
to too many cues and misinterpret the tester's expecta- 
tions. These aspects of the experimenter-subject relation- 
ship have barely been touched in research yet. 

One of the points in testing at which the tester has to 
be most wary of providing cues for patients is wher eluci- 
dation of a response is required, In the W.A.I.S. Compre- 
hension subtest the tester may have to ask the patient to 
explain his initial response to a question. In doing this he 
may unwittingly vary his questioning in such a way as to 
elicit behaviour which will confirm his expectations about 
the patient. 

In open-ended tests, where judgements have to be made 
in scoring, a tester may score harshly in one case but 
leniently in another, This may be done quite unwittingly 
but with the effect of confirming expectations, 

A tester might derive his expectations as to what the 
patient will do, in different ways. He may make up his 
mind about the patient after reading the case history or 
hearing the psychiatrist’s opinion. If he has no definite 
expectations before he starts then he may be influenced 
by the early responses in the test session. These are known. 
as early data returns. The tester may perceive some 
apparent trends in the early responses which lead him to 
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influence the ensuing responses so as to confirm these 
trends. Rorschach users are even advised to start assessing 
responses from the beginning of the administration of the 
cards. It is suggested that this procedure heightens the 
alertness of the tester in what otherwise might prove a 
rather tedious task. Obviously the early data returns may 
well provide expectations as to what kind of responses the 
patient will make later. 

Although the effects which testers can have on results 
have long been recognized the interest shown in this 
problem has been negligible, Few psychologists have 
recognized it and those who have have mainly discounted 
it. Recently there has been an upsurge of interest and a 
number of reviews have appeared (Kintz et al, 1965; 
Rosenthal, 1964). Undoubtedly this neglected variable, the 
tester, will be much investigated in future, With more 
knowledge it will be possible to measure the extent of the 
influence of the tester on the results he obtains and some 
degree of control over this influence may eventually be 
gained, 

In the meantime what steps can be taken to minimize 
the effect of the tester’s outcome orientation? One 
manoeuvre is to have tests administered by testers who 
know nothing of the patients they test, and who are not 
told the reasons why they are giving the tests. The patient 
is seen by one psychologist who decides what tests will be 
used, He is then handed on to another psychologist or a 
testing assistant who administers the tests, Testing is thus 
‘blind’ in the same sense that drugs are administered 
‘blind’ in drug trials. Unfortunately there is evidence that 
even this procedure does not eliminate the effect of the 
tester. In one investigation it was found that the experi- 
menters' expectations can be subtly communicated to the 
testing assistants. The only trouble with experiments on 
the experimenter effect of course is that they themselves 
are open to bias from the experimenter effect! 

Another manoeuvre is for the tester to present the teg 
record for analysis to an interpreter who knows nothing 
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more than perhaps the patient's age and sex. In this case 
the interpretation is done blind, since he does not know 
the reason why the test is given. If both of these 
manoeuvres are adopted, testing blind and interpreting 
blind, then a team of three would be required for the 
assessment of each patient: the person who decides what 
tests shall be given, the tester, and the test interpreter. 

The influence of the tester on test results is minimized 
in tests that are self-administered. Where the patient can 
read instructions and do a test by himself, interaction 
between patient and tester is virtually eliminated. It may 
even be possible to devise machines, programmed to in- 
struct the patient what to do. This in fact has been done 
on a limited scale already. The patient's understanding 
would be tested on examples provided in the programme 
and he would only be introduced by the machine to the - 
test proper when he had grasped what he had to do. This 
may work where the subject's motivation and understand- 
ing of the tasks set him are adequate. In psychiatric work | 
however this is frequently not the case. Patients often - 
have to be persuaded to do tests and then encouraged to — 
continue to the end, If the patient has anxieties about the — 
tests these can be discussed with a tester but not with a 
machine. The reverse is also true. Many patients are much. 
happier doing tests alone than with a tester hovering over 
them. UM 

One way of eliminating the transmission of visual cues j 
from tester to patient in the test session would be to place" 
a screen between them. Space could be left between the 
table top and the bottom of the screen to allow the tester — 
to see what the patient is doing and to present test 
materials to him. This arrangement would naturally elim- 
inate the transmission of visual cues from the patient to i 
the tester so that the patient's grimaces, boredom, excite- 
ment, fear and so forth would be lost to the tester. Í a 

Perhaps the most significant implication of this dis- | 
cussion for testing is that testers should be alerted to the 
experimenter effect so that even though they may not 
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able to measure its effect nor control it, at least they may 
allow for it in drawing conclusions from test data. Un- 
doubtedly the first step on the way to controlling this 
effect is to recognize that it exists. It cannot be long be- 
fore this recognition becomes universal among psycholo- 
gists. Only when it is recognized can further steps be 
taken towards controlling it. 

How important in clinical psychology is the experi- 
menter effect? Certainly it has been demonstrated in a 
number of studies to have a significant influence in a 
variety of experimental and test situations. But does it 
affect the actual conclusions drawn from tests in indi- 
vidual cases? It may be that the effect is slight and only 
achieves significance when large numbers of subjects are 
used. If this were the case it could be safely ignored in 
considering the results of the individual patient. Probably 
it is significant in some cases but not in others. At the 
present state of our knowledge it is safest to accept that 
it can have appreciable effects and to regard it as poten- 
tially biasing in every case. 

"The effect can enter into assessment whichever method 
is used. When statistical methods of inference are used it 
is less likely to obtrude at the level of inference. At the 
level of testing, the effect is as likely to occur here as 
when other methods are used. When clinical inference is 
used it could create havoc if it were not recognized. The 
psychologist who is aware of the effect may be able to 
make some allowance for it in drawing his conclusions. 
Oddly enough if it goes unrecognized, it is as likely to 
bias findings when experimental investigation of patients 
is undertaken as when either of the other two methods 
are adopted. If it is recognized then the experiments can 
be designed to take account of the experimenter effect. 

To summarize: It is known that the clinical psycho- 
logist can influence the sort of test results he gets from 
patients he tests. Often the extent of this influence is not 
known. However, there are various steps which can be 


taken to reduce this influence. Although there may be ob- 


` may turn out ultimately that it will be possible to intro- 
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jections to these attempts to eliminate the effect they 
should nevertheless be taken to their logical conclusion in 
order to discover what their limitations are in practice. It 


duce the patient to a machine which will administer tests, 
score them, analyse the results and print out its con-. 
clusion! (See chapter 8.) Gedye (1966) has already 
demonstrated that this can be done, 


8 Research in Assessment 


This book has been mainly orientated toward the practical 
contribution which clinical psychology has to make to 
psychiatry. Consequently in considering research in assess- 
ment the aim here is to draw attention to research needs 
at the applied level. Although research having less 
immediate relevance may ultimately prove to have a great 
influence on day-to-day practice, there is so much bread- 
and-butter research that needs to be done that the former 
will not be discussed further here. 


"The Need for Research 


In the first chapter the need for psychological tests was 
demonstrated and their advantages were outlined. In sub- 
sequent chapters attention has been repeatedly drawn to 
their shortcomings and limitations. The shortcomings 
listed below are brought together to show how vulnerable 
to criticism are the tools of the clinical psychologist. If 
these criticisms are to be overcome, extensive research is 
urgently required. 

(1) Subjectivity Despite the inexorable movement to- 
wards objectivity many tests are still used subjectively. 
The extensive use of the clinical method of evaluating tests 
is not matched by the extensive validation of clinicians’ 
judgements. 

(2) Triviality The emphasis on objectivity has led to the 
development of many tests which are certainly objective 
but which produce such trivial findings as to be of no 
Practical use. 

(3) The validity of many tests leaves much to be desired. 
One reason for this is that psychiatric diagnosis has 
generally been the criterion for validation of tests. This is 
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not a satisfactory criterion because of the lack of agree- 
ment between psychiatrists in diagnosing patients. 4 
(4) Diagnostic implications Very few tests have been i 
validated against treatment-outcome and follow-up so 
that the practical implications of test results for prognosis 
and treatment are generally unknown. 
(s) Descriptive implications Frequently it is not clear 
what psychological functions are being measured by a test. — 
(6) Base rates For many purposes it is essential to know _ 
the base rates if tests are to be used. Adequate data are in- 
practice rarely available, ri 

(7) Overlap Interpretation of scores of individual a 
patients on tests developed with groups of subjects is 
often impossible because overlap of scores of groups is so 
great, 
(8) The experimenter effect may influence results on any | 
test. The extent of this influence is virtually unknown. . 
(9) Standardization Tests are frequently not standard- 
ized on the type of patients for whom they are intended Et 
in clinical use. Thus a test of thinking disorder may be - 
shown to discriminate between patently thought-dis- | 
ordered schizophrenics and normals but it is the not-so- 
Obvious case which is referred to the psychologist. 

When listed in this way the cumulative effect of these 
criticisms is rather devastating. It should be stressed that 
not all tests are subject to all of the criticisms, One also. 
takes comfort from the criticisms of Psychiatric assess: 
ment made in the first chapter to justify the use of psy- - 
chological tests. If the Psychologist is not a good oracle at 
least he may well be better than alternative oracles. More 
important he is a self-correcting oracle and more alert to 
the need to carry out research to improve his efficiency. 


The Need for Clinically Based Research 


The great need for clinical Psychologists to do research 
does not mean that they should retire from the clinical 


op 
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sary research. On the contrary, research in clinical psych- 
ology has to be pursued in a clinical context. Where it 
becomes divorced from clinical practice its clinical relev- 
ance diminishes, Researchers must inform themselves by 
clinical experience. Clinical psychology has been a child 
of whom people have had great expectations; only by the 
constant interaction of research and practice can it fulfil 
that promise. 

In arguing this point one is a little embarrassed by the 
fact that much of the clinically based research in clinical 
psychology in the past has proved rather unfruitful. It is 
true to say that recent progress has been made by psych- 
ologists who have not been committed to clinical work, 
because they have been able to take an independent and 
detached look at the field. But it is painfully obvious 
when research is done which is not jnformed by clinical 
knowledge and insight. We are now in a position to go 
back to clinical research, enlightened by this visit to the 
laboratory. 

It is the combination of clinical experience and research 
know-how that is powerful. Clinically based research may 
be practically orientated but frequently makes perfectly 
valid scientific contributions. It is in just this kind of area 
that distinctions between pure and applied science become 
meaningless, An example of the kind of research which is 
based on extensive clinical knowledge is the work of Mc- 
Ghie and his colleagues (McGhie and Chapman, 19615 
Chapman and McGhie, 1962). After careful description of 
the subjective experiences of early schizophrenics they 
attempted. to provide standard laboratory conditions to 
Observe the disordered attention which they held to under- 
lie the symptoms described by their patients. This 


laboratory simulation of the conditions which provoke 
to measure abnormal be- 


S toms and the attempt orms 
AES in this way is a valuable step in the direction of 
achieving experimental control o 
basis of their clinical and experiment 
suggested ways in which communica! 


ver symptoms. On the 
ental studies they have 
tion with schizo- 
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phrenics may be improved. This involves limiting the in- 
put of information to a level at which the patient's dis- 
ordered attention mechanisms can cope. This work, 
then, has therapeutic implications as well as advancing our 
scientific knowledge of schizophrenic behaviour. 
Another way of formulating the problem of clinically. 
based research is to say that one can find rigorous research 
(meaning good design, use of controls where necessary, 
use of objective techniques, sophisticated and appropriate 
Statistical analysis) applied to significant problems as well 
as to trivial problems. One can also find sloppy research 
on both significant and trivial problems. There are argu- 
ments as to whether it is preferable to have sloppy re- 
search on significant problems or rigorous research on 
trivial ones. Ideally rigorous research on significant issues — 
is to be sought but the achievement of this depends on the 
training of the investigator. Those who have invested 
time in getting training in research techniques often lack - 
the knowledge to pick significant problems so they fall — 
back on laboratory-generated problems which take them 
away from the practical problems of living which patients - 
have to face, Such researchers consider they are being true 
to their scientific integrity in doing fundamental work. 
Those who have invested time in getting clinical experi- 
ence and are more aware of significant issues tend to be 
lacking in the art of research, Although these two | 
Stereotypes exist there are enough clinical psychologists 
who manage to combine the two disciplines to demons- bi 


trate that good research into significant problems can be 
done. p 


Individual Cases 


The work of the clinical psychologist provides him with | 
the opportunity of studying individual patients in depth. — 
The emphasis on group statistics and nomothetic re- - 
search has led to a neglect of the scientific study of 

individuals. Yet there is a very respectable history, n 
psychology and medicine, of significant work resulting 
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from single cases. Ebbinghaus' study of memory using 
himself as subject is a classic example. 

There has been no-one whose influence on both psych- 
Ology and psychiatry has been greater than Freud and 
Pavlov. Yet the works of both men were based on inten- 
sive study of single subjects: in Freud's case, patients, in 
Pavlov's case, dogs. 

'The detailed study in depth of a few patients is often 
more productive than superficial studies of large numbers 
of people. Idiographic and nomothetic approaches are of 
course complementary. It is a pity that the idiographic 
has been so much neglected in clinical psychology. 

One way in which a commitment to the study of single 
cases benefits the clinical psychologist is that he is pre- 
pared to make the best research use of infrequent condi- 
tions. He becomes serendipitous. If something happens 
relating to thé behaviour of a patient, which is unusual 
but which the psychologist recognizes as having important. 
implications for either theory or practice, he should be 
Prepared to investigate this to establish just how impor- 
tant these implications are. By acquiring techniques and 
methods for studying single cases the psychologist is 
improving his powers of serendipity. 

In the study of single cases for research purposes the 
experimental method described in chapter 3 is the method 
par excellence. Research having implications beyond the 
individual patient has frequently developed from the de- 
tailed investigation of single patients initially carried out 


for purely clinical purposes. " Mod 
An important research task having a clinical orientation 
is to find out how far tests, which have been developed in 
research with groups of patients, can be applied to 
individual patients. ay 
In SAAN a commonly used method of achieving 
Positive results is to make up two groups from SERE 
located at the opposite extremes of some dimension a 
to compare them on a test. The sedation threshold dis- 


tinguished satisfactorily between extremes of dysthymics 
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and hysterics and a claim was made that it was useful in 
the clinical investigation of patients (Claridge and Her- 
rington, 1963). When Moffat and Levine (1964) examined 
this claim by testing a whole range of neurotic and 
character-disordered patients including the middle range, 
they were unable to confirm it. To test the application 
of research findings in the clinical situation requires a 
research project in itself. The aim of such studies is to 
bridge the gap between research (n which the primary 
aim is not clinical) arid the clinical application of those 
research findings. Even when such studies are negative 
they may expose variables which require further study — 
before positive clinical relevance can be established, The 
practically orientated research then feeds back to the so- 
called pure research, 


Basic Data Collection k. 


If nomothetic tests are to be more useful in individual f 
cases a great deal of basic information about those ‘tests. 
will have to be collected. This is a continuing need. 
Standardization for local use of tests standardized else- 
where is necessary. The use of the M.M.P.I. and W.A.I. 
in Britain has always been questionable without local 
norms. Local base rates will need to be sought for deci- - 
sions as to the utility of tests. If the diagnostic implica- ' 
tions of tests for treatment, prognosis, description and | 
etiology are to be known, norms for each of these cate- - 
gories will be required, Test data from which probabilities — 
attaching to scores of individual patients can be deter- 
mined will be necessary. i 
There is a great need for more comparative data from bi 
normals. Little is known concerning the relative rates of - 
decline in short-term memory for visual and auditory 
material in the normal process of ageing. Data on normals " 
is essential for the assessment of pathological memory 
decline. a... j 
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The introduction of automation into clinical psychology 
can fairly be said to have hardly begun. But enough has 
been done to indicate that this is going to be one of the 
growth points for far-reaching future developments. 

The same objections have been raised to automating 
assessment procedures as have been raised to automating 
teaching by means of machines. It is suggested that the 
essentially human aspect of psychological assessment is 
lost or that psychologists will becorne machine operators. 
The answer to these points is that individual testing 
by psychologists is a very time-consuming business and 
the supply of clinical psychologists will not meet the need 
for the foreseeable future. We will have to make use of 
whatever technical aids we can if an adequate psychologi- 
cal service is to be provided. If automation can take over 
some of the functions of the psychologist he is thereby 
released to concentrate on the tasks for which he is 
essential, one of which is to develop improved methods of 
assessment. 

The objection to the dehumanizing of assessment is 
discussed in chapter 7 where it is shown that testers can 
bias the results which they get from tests and it is sug- 
Bested that automation may be positively useful in over- 


coming such distortions. 


Machine scoring 

Many tests such as questionnaires require a patient to 
leave a record of his responses as he does the test. With 
the advent of mark-sensing devices, record sheets can be 


processed by a machine, which gives a print-out of the 
patient's test results. This can provide an enormous saving 
of the psychologist's time. x 

The record sheets have to be specially prepared for this 
Purpose and generally the patient fills them in heut 
thick pencil by marking the paper with a line in the 


appropriate place. 
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Analysis of patient's responses 


Computers have been programmed to take over the de- 
tailed statistical work which can be involved in analysing 
the test results of individual patients. P. Slater (1965) has 
prepared a program for the analysis of repertory grid 
data involving the calculation of many rank-correlation 
coefficients and a principal components analysis. 

Where analysis calls for calculations of the kind recom- 
mended by Payne and Jones (1957), or reference to 
normative data concerning base rates or the application of — 
objective rules such as Meehl and Dahlstrom (1960) .. 
describe, then these procedures can be built into computer 
programmes for routine use. 

Beyond straight calculation is the detailed interpreta- 
tion of test results. Finney (1966) amongst others, has - 
"described the programmed interpretation of questionnaire P 
data. The method 'selects for each individual about a 
hundred statements from a repertory of about a thousand. 
It combines ‘the separately chosen statements into a report | 
reading much like a spontaneously composed one. It 
attempts to describe the conscious or unconscious motives ay 
and defences and the patterns of interpersonal relations. d 
typical of each person’ (p. 81). All this is based on the — 
patients M.M.P.I, and C.P.I. protocols fed into the — 
computer which out-puts a report as described above. ^ 


Administration of tests by machine 


machine administration. 
Where testing requires a patient to respond to sequences. ! 
of stimuli, as in the measurement Of reaction time, the 
presentation of stimuli and the recording of responses can 
be automated to relieve the tester of the job of press 
keys, reading dials, noting scores and so on, 
The new technology of teaching machines has 
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adapted by Gedye (1966) to the automation of procedures 
for testing learning and memory. But Gedye's configura- 
tion (now in commercial production) will undoubtedly 
have very general applications and recommends itself to s 
the whole field of assessment in clinical psychology. i 


Multi-access, on-line, real-time computer facilities g3 


The computer world is providing us with a whole new set 
of jargon to juggle with. ‘Multi-access’ means that there is — 
more than one terminal to a computer. With very large 
computers two hundred people or more may be in 
simultaneous communication with one computer. Each 
user may have his own in-put and out-put device in his | 
office, This of course poses problems of security for con- - 
fidential records and various methods have been devised i 


to ensure that unauthorized people cannot elicit informa- - 
LI D 


; 


tion. 
‘On-line’ means that a device is directly connected to a - 


‘Real-time’ means that the computer can im- 
deal with the in-put from various sources so that | 
ne job to be completed 


computer. 
mediately 
a user does not have to wait for o 


before he can use it. 
The advances in computer technology mean that a 
linked with various de- 


hospital's own computer can be e 
partments, each of which will be able to use the computer 
as the need arises. Data can be fed in and out-put as 
required. Thus the pathology laboratory can feed in 
results of tests or even have measures actually being re- 
corded on the patient fed directly to the computer. 
Nursing reports, doctors' reports, and social workers re 
ports can be in-put as soon as they are available. Similarly 
psychologists’ test results and reports can be in-put as 
they become available. Indeed where psychological tests 
are being administered by teaching machine they also o 
be linked directly with the computer. ) 
The A ds out-put will be determined by the needs 
of the questioner. A clinical psychiatrist may ask fous 
complete case history, a summary, or the ts of a 
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particular test. As Finney has shown, computers can be 
programmed to arrange their out-put in readable and 
sensible English. An administrator may want to find out 
how many patients of a particular kind the hospital is 
dealing with over a period. The psychologist may wish to 
find out the base rates for some condition. 

One of the great advantages of computers to the 
hospital service is that they provide a means of keeping 
permanent and easily accessible records. Indeed informa- 
tion retrieval is so rapid that analysis of records is now 
possible which previously could not be contemplated, 

A hospital computer therefore serves clinical, adminis- 
trative and research needs, 


Current applications and future developments 


Each one of the automated methods described in this 
chapter has actually been put into operation. This is not 
a fantasy of what might happen in future but a state- - 
ment of what has already been done. 

It would be wrong to give the impression that these 
methods are widely available in this country at the present 
time. Nearly all regional hospital boards in Britain have 
computers but none provides multi-access facilities yet and 
there is virtually no computer. time being provided for 
clinical applications. At the time of writing one or two 
hospitals in this Country have small computers for 
clinical work but no hospital is providing computer time 
for the kind of clinical Psychological and psychiatric 
applications described in the preceding sections, 

Before automated methods are introduced on a wide 
Scale considerable technological development will be re- 
quired, but as they become more available so they provoke 
more research. Yet again clinical Psychology is seen as 
both applied and pure science, 


Role of Theory 


There is an undoubted need for a self-conscious appraisal 


Role of Theory 


on the part of researchers in this field of the need for - 
theory. | 
Tolor and Schulberg (1963) point out how so-called 
empirical research is often of little value. In evaluating — 
research on the Bender-Gestalt Test they note the 'great 
preponderance of low level conceptualizations’ and the 
need for more ‘theoretical underpinning for the Bender- A 
Gestalt Test which would clarify exactly what the test — 
measures and how it does so' (p. 202). ; Í 
There are two sides to this problem. On the one hand | 
there is the spectacle of speculation running far ahead of —— 
research findings. Theorists are reluctant to wait until — 
findings have been established, replicated, crossvalidated a 
and consolidated, While on the other hand research is — 
meaningless unless and until it is related to theory. 
Exploratory research, in which the researcher says ‘It 
would be interesting to see what would happen if we did * 
this’, tends to be regarded with some contempt. But this 
sort of approach is a necessary stage in the development — 
of any science. However, too often as Bender (1963) . 
points out exploratory research is undertaken when hypo- — 
theses are available for testing but are ignored. 1 
Generally there should be little difficulty in relating UM 
research to theory considering the number of contending i 
theorists in the field. Some theories are concerned only | 
with specific behaviours, having little general application - 
beyond that behaviour. Others are very general having - 
implications for apparently quite unrelated areas of | 
behaviour. » 
/ Some researchers attempt to synthesize different | 
approaches and take what they can from wherever they 
can get it. Others prefer to follow a particular line with | 
single-mindedness to see how far it will take them. a 
If the complexity of human behaviour is recognized — 
then it is clear that no one approach will provide all the 
of our knowledge | 


answers and that in the present state 
diversity of theoretical approaches is to be encouraged. 
ry 
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The following notes have been included for the benefit of 
readers who are not familiar with the tests mentioned in 
the text. Although many of the tests in this list are widely 
used many are not. Indeed many are outdated or for re- 
search only. The list should not be taken as a representa- 
tive sample of tests used in clinical psychology. A fuller 
list of tests used by clinical psychologists is given in 
appendix 2. 

For further description and evaluation of tests the 
reader is referred to the manuals on the tests, to Buros 
(1965) and to the journals, 

Tests which are commercially available can mostly be. 
obtained either from the National Foundation for 
Educational Research, The Mere, Upton, Slough, Buck- 
inghamshire, England, or from the Psychological Corpora- 
tion, 304 East 45th Street, New York 17, New York, 
U.S.A., both of which provide catalogues of tests. 


A.H. 5 (Heim, 1956) 


A test of high level intelligence in two parts: Part I 
requires verbal and numerical skills, Part 2 requires visual 


analytical skills, Sometimes used in university selection. 
British norms, 


Archimedes Spiral (see reviews in Buros, 1965) 


A spiral drawn on a card which when rotated gives an — 
illusion of movement, either expanding or contracting. 
When a person has fixated this for a period and the card - ^ 
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of time this after-effect takes to wear off varies and has | 
been related to psychiatric variables such as brain 
disorder, hysteria-dysthymia and psychosis. 1 


Bender's Visual-Motor Gestalt Test (Bender, 1938) 
Nine designs copied one at a time by the patient. Im- - 
paired patients tend to make more errors. Originally 
protocols were assessed qualitatively for breakdown of the 
gestalts. Scoring systems are now available (e.g. Pascal and — 
Suttell, 1951). j 


er 


Dz 


Bernreuter Personality Inventory (see reviews in Buros, 
1965) 

' 
A pre-war questionnaire claimed to measure introversion, P 
neurotic tendency, social dominance, confidence, self- A 
sufficiency and sociability but discredited by factor analy- - 


tic work and superseded by other questionnaires. i 


Body-Sway Test of Suggestibility (Eysenck, 1947) 
d listens to a record telling - 


The patient stands upright an 
e extent of body movement | 
t 


him he is falling forwards. Th 
is measured. 

California Psychological Inventory - C.P.I. (Gough, 1957). 
ghteen scales concerning: 


Personality questionnaire with ei s 
d responsibility. 


social qualities such as tolerance an 


Cattell’s Sixteen Personality Factor Questionnaire 
P.F. (Cattell and Eber, 1957) 
r analytic studies and providing 
as well as two 
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E.P.I). Two parallel forms (A and B) and a shorter form 
(C) in simplified English. Each form takes about fifty 
minutes to complete. 


Coloured Progressive Matrices (Raven, 19582) 


An adaptation of the Progressive Matrices for use with 
children, subnormals and old people, 


Distraction Tests (Chapman and McGhie, 1962) 


Devised in an attempt to measure distractibility, Patients 
are required to perform various tasks such as tracking the 
lateral direction of movement of a spot of light whilst being 
subjected to distracting irrelevant stimulation such as 
sounds presented over headphones. The errors in the 


Performance of the task, with and without distraction are 
compared, 


Epstein’s Test of Overinclusive Thinking (Epstein, 1953) 
A paper and pencil test of schizophrenic thought disorder 
in which five words are presented, alongside a word desig- 
nating some concept such as ‘house’. The patient has to 
underline words which are a necessary part of that con- 
cept, e.g. walls and roof are, but telephone is not. Over- 
includers tend to underline many more unnecessary - 
things. Not adequately developed for clinical use, 


Eysenck Personali 


ty Inventory — E.P.I. (Eysenck and 
Eysenck, 1964) 


This revision of the Maudsle 
(M.P.I.) provides scores for two 
and Extraversion (B), 


British norms. Takes 5-10 minutes to complete, 


y Personality Inventory 
scales — Neuroticism (N) 


as well as a lie scale. Extensive — 


MOEA ISI DTE 
"* , no . " 
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~~ sent trial and his estimate for the next one. 


Family Relations Indicator — F.R.I. (Howells and 
Lickorish, 1962) 

Thirty-three cards with drawings of family situations, 
Used with children who are encouraged to make state- 
ments about the activities of the people shown, rather tha; 
make up stories. Used to investigate the child's relatio; 2 
ships with other members of the family. a 


Galvanic Skin Response — G.S.R. (Ve i 
eH (Venables and Martin, 
Also called psychogalvanic response (P.G.R.), electro- 
dermal response (E.D.R.). A physiological measure of 
palmar sweating which is one component of emotional 
arousal. Often measured together with other arousal com- 
ponents such as muscle tension, respiration, blood volume, * 
pulse rate, pupil size, etc., by means of a polygraph. j 
Popularly known as a lie detector. 


Goldstein-Scheerer Tests of Abstract Ability (Goldstein 
and Scheerer, 1941) i 
M. 


A battery of five tests requiring visual and motor abilities: _ 
cube test, colour sorting, object sorting, form sorting, - 
stick test, Used in assessing abstract-concrete attitudes in 
brain disordered patients. No quantification therefore no — | 
$ 


published standardization. 2 I 


1 


Tnm 


Level of Aspiration (Eysenck, 1952) 


ai 


well h 
which he says how well he thin! 
cedure is repeated several times. Scores are derived indi- — 
cating (1) the average discrepancy between his actual - 
score and his estimate of how well he would do; (2) the 


average discrepancy between his actual score on the pre- 
E 
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Memory for Designs - M.F.D. (Graham and Kendall, 
1960) 


A series of fifteen designs presented briefly one at a time 
to the patient who has to draw each design on paper as 
soon as it is removed. A test of visual retention which 
takes about fifteen minutes, The quality of reproduction is 
often impaired in brain-disordered patients. 


Mill Hill Vocabulary Test (Raven, 1958b) 


Includes a multiple choice (synonyms) test and a defini- 
tions test of word knowledge. British norms. Takes about $ 
ten minutes per patient. Used in conjunction with Pro- 

gressive Matrices, 


Minnesota Multiphasic Personality Inventory - M.M.P.I. 
(Hathaway and McKinley, 1951) 


Five hundred and fifty statements answered ‘true’, ‘false’ 
or ‘cannot say’. Provides scores for nine clinical scales, but 
research has extended this (see Taylor's M.A.S. for ex- 
ample) to over two hundred scales of ego strength, hos- 
tility, etc. One of the most popular questionnaires. 


Modified New Word Learning Test — M.N.W.L.T. 
(Walton and Black, 1959) 


"The meanings of the first ten words on a vocabulary test. Ni 
which are failed by a patient are taught him, After each — 
Presentation of the list of meanings the patient is tested — 
to see how many he has learned. Word learning tends to 


be impaired in brain-disordered patients, 1 


Nufferno Speed and Level Tests (Furneaux, 1960) 


Problems of the letter series type. Level test allows un- 
limited time for patient to show how far he can get with- | 


^N 


Tre i 
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out a time limit. In the speed test his rate of work on 
problems he gets right is measured. British norms. 


AS arte Personality Test Battery (Cattell et al, 
1955, 


À number of tests including reaction time, a finger maze 
and galvanic skin response. Some requiring paper and 
pencil, some apparatus. Time-consuming to administer. 
Used to measure eighteen traits such as ‘general inhibi- 


tion’. 


Peg-Board (as in G.A.T.B. — see United States Employ- | 

ment Service, 1966) Y 
A motor task in which the patient has to transfer pegs - 
which fill the holes in one half of a board to the holes in- 
the other half which are empty. The rate at which the 
pegs are transferred is a measure of his dexterity. 


Piaget's Conservation Tests (Piaget, 1929) 

Used with children to determine conceptual development. ` 
In one test two equal amounts of the same material, for - 
example, plasticine, are made into different shapes — ball _ 
and sausage, for example — and up to a certain stage the — 
child conceives of the amount as varying with the shape, 
even when he sees that none has been added or taken - 


away from the original amounts. : a 
«1 


S 
Porteus Mazes (Porteus, 1965) 


A series of mazes increasing in level of difficulty. Patient . 
has to trace his way with a pencil through each maze. 
which is printed on paper, without crossing lines, going 
down blind alleys, lifting his pencil, etc. a 
Two scores are derived: (1) test age which is regarded — 
as a measure of foresight and planning, (2) an error score _ 
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(Q score) summarizing the number of times pencil lifted, 
etc, which has been related to temperament and delin- 
quency. 


Progressive Matrices (Raven, 1960) 


A multiple choice test of perceptual reasoning which is 
relatively uninfluenced by educational and cultural back- 
ground and therefore is a good indicator of native ability. 
'Takes about forty to fifty minutes per patient. British 
norms. Widely used. Virtually self-administering. Used in 
conjunction with the Mill Hill Vocabulary Test. 


Q Sort (Block, 1961) 


Statements on cards are sorted by the patient according 
to some direction, for example, from ‘most like me’ to 
‘least like me’ in a fixed number of categories (say nine) 
and the number of cards to be placed in each category is 
fixed to give a near normal distribution. A second sort for 
‘like I'd like to be’ would provide data which could be 
correlated with the first sort. Some standard decks of 
cards are available. Often ad hoc cards are used, 


Reaction-Time - R. T. (Woodworth and Schlosberg; | 
1954) 


The patient holds a morse key down and is instructed to 
release it when he receives the signal which may bea light 
flashing on. The time taken to react to the signal is | 
measured by an electronic timer, 


Repertory Grid Technique (Bannister, 1965) 1 


A method by which the constructs (attitudes, sentiments, j 
concepts) of a patient can be studied. Many variations in 
content and scoring, but the basic method is to get the | 
patient to apply a set of constructs (e.g. kind, honest) t iO 
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a set of elements (e.g. people he knows, photographs of 
people). This is often done by ranking the elements. The 


correlations. 


Rorschach Ink Blots (Klopfer and Davidson, 1962) 


Ten cards with ink blots shown one at a time to the 
patient who is asked to say what they remind him of. In 
structuring such unstructured material as ink blots people 
are assumed to ‘project’ their own personalities. This is 
therefore a projective test. Responses are classified and re- 
lated to personality traits and diagnostic categories. Very 
popular with clinical psychologists in America, less so in 
Britain. 


Sedation Threshold (Claridge and Herrington, 1963) 

A measure of tolerance of a depressant drug. Sodium 
amytal is injected into the patient at a known rate whilst 
he doubles digits presented to him every two seconds. The 
point at which he begins to make errors is his sedation 
threshold and has been related to many psychiatric vari- 
ables especially hysteria-dysthymia, 


- Semantic Differential — S.D. (Osgood et al., 1957) 


- interrelationships between the constructs are indicated by - 


Ji 


The patient rates various concepts on a number of rating 
scales, such as good-bad, strong-weak. Concepts selected 


depend on the assessment problem posed, but might in- 
clude the patients symptoms or socially desirable be- 


- haviour. Scores may be derived for the three major factors 


demonstrated by factor analysis — evaluation, potency and 
activity and the concepts plotted graphically in ‘semantic’ 
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Shapiro's Personal Questionnaire (Shapiro, 1961) 


Statements elicited from a patient about his symptoms 
are scaled for severity. A paired comparison technique is 
then used to provide scores for symptom groups. When 
the questionnaire is administered over a period of time 
the relationships between the scores show how the symp- - 
toms are changing relative to each other. Used particularly 
in assessing the effects of treatments, 


Shipley Hartford Scale (Shipley, 1946) 


: (1) vocabulary, 
(2) reasoning. A discrepancy between scores on the two. 
sections was intended as a measure of cognitive impair- 


ment. Now occasionally used as a quick test of intelli- ` 
gence, 


A brief screening test with two sections: 


CN 
"Taylor's Manifest Anxiety Scale - M.A.S. (Taylor, 1953) - 


Fifty-item questionnaire. Items taken from M.M.P.I. 


Highly correlated with E.P.I. N scale and 16 P.F. Anxiety. i 
factor. 


A series of cards showing scenes, around which the patient _ 
is asked to make up stories. Each picture allows of a range NA 
of different interpretations, and it is assumed. that th: >) 
story selected by any particular person is determined b 
his’ personality. In the analysis of the stories attention i i 
paid to the themes, needs and pressures expressed. 


1955) 


Widely used by clinical psychologists. Requiring indivi- 
dual administration. Takes about 1} hours to test ‘on e 
patient. Well standardized in America, but no British 
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norms available — eleven subtests, covering a wide range of 
abilities, are grouped into two scales: (1) verbal, including 
vocabulary, comprehension, (2) performance, including 
manipulative and perceptual tasks. Discrepancies between 
Scores on different subtests are often examined for their 
relation to psychiatric states. For ages sixteen years and 


over. For ages five to fifteen years the children's version is - 


used: Wechsler Intelligence Scale for Children — W.I.S.C. 


Wechsler Bellevue (Wechsler, 1947) 
The fore-runner of the W.A.LS. 


Word Association (Woodworth and Schlosberg, 1954) ý 


A list of words is read out to the patient who has to s: 
the first word he thinks of as each word in the list mE. D 
out. Some standard word lists are available. Sometimes 
words are presented having particular significance for the 
patient. The reaction times and quality of association are 
taken as indicators of the emotional significance of 


stimulus words. 
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Appendix 2 
Tests Used in Clinical Psychology 


The tests listed below are presented because they are ones - 
which the clinical psychologist may expect to come acros: 
in his search for measures of behaviour and among which 
he will have to make choices, The list is not exhaustive | 
and the classification is one of convenience. Each test 
been listed only once whereas some of them could well... 
have been listed under several categories. 


Educational Attainments 

Reading 

Burt Reading Test , 
Gates-McKillop Reading Diagnostic Tests 
Graded Word Reading Test (Schonell) 
Graded Word Reading Test Quis) 
Gray Oral Reading Test 

Neale Analysis of Reading Ability 


Arithmetic 


Burt Arithmetic Tests 
Schonell Arithmetic Tests 


Intelligence and Abilities 
Adult 


A.H.5 

Cattell Intelligence Tests 
General Aptitude Test Battery 
Illinois Test of Psycholinguistic Abilities 
Kent Series of Emergency Scales 
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Mill Hill Vocabulary Scale 
Nufferno Tests of Speed and Level 
Porteus Maze Test 
Primary Mental Abilities 
Progressive Matrices — Standard 
— Coloured 
— Advanced 
Shipley Institute of Living Scale for measuring 
intellectual impairment (Shipley Hartford) 
Wechsler Adult Intelligence Scale 
Wechsler—Bellevue Intelligence Scale 


Children 


Cattell Infant Intelligence Scale 

Columbia Mental Maturity Scale 

Full Range Picture Vocabulary Test 

Goodenough-Harris Drawing Test (Goodenough Draw- 
a-Man Test revision) 

Griffiths Mental Development Scale for testing babies 
from birth to two years 

Merrill-Palmer Scale of Mental Tests 

Peabody Picture Vocabulary Test 

Stanford-Binet Intelligence Scale 

Wechsler Intelligence Scale for Children 


Performance Tests 


Alexander Performance Scale 

Arthur Point Scale of Performance Tests 

Drever and Collins Performance Tests of Intelligence 
. Kohs Block Design Test 


Memory 


Benton Visual Retention Test 
^ Memory-for-Designs Test 
__ Wechsler Memory Scale 
"d Williams Delayed Recall Test 
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Word Learning 


Modified New Word Learning Test 
Neologisms Learning Test 

Paired Associate Learning Test 
Synonym Learning Test 


Speed 


Reaction Time 
Tapping rate 


Perception 


Archimedes Spiral After Effect 

Bender Gestalt Test 

Critical Flicker Fusion 

Gottschaldt Embedded Figures 

Marianne Frostig Developmental Test of Visual 
Perception 

Minnesota Percepto-Diagnostic Test 

Two Flash Threshold 


Aphasia 
Examining for Aphasia (Eisenson) 
Concrete-Abstract Attitude 


Chapman Figurative Literal Test 

Diagnostic Performance Tests (Semeonoff_Tri $ 

Goldstein-Scheerer Tests of Abstract and Concrete 
Thinking ! 

Grassi Block Substitution Test 

Reitman’s Pin-man Test 

Shaw Test 

Vigotsky Sorting Test 
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Schizophrenic Thinking Disorder 
Chapman Overinclusion Test 
Epstein’s Test of Overinclusion 
Grid Test (Bannister and Fransella) 
Lovibond's Test of Overinclusion 
Payne’s Object Classification Test 
Proverbs — Gorham’s 

— Benjamin’s 


Personality — Attitudes, Conflicts, Needs and Traits 


Adult projective 


Four Picture Test 

Holtzman Inkblot Technique 
House-Tree—Person Test 

Kahn Test of Symbol Arrangement 
Lowenfeld Mosaic Test 

Machover Draw-a-Person Test 
Make-a-Picture Story Test 

Object Relations Technique 
Rorschach Inkblots 

Rosenzweig Picture-Frustration Study 
Rotter Incomplete Sentences Blank 
Symonds Picture Story Test 

Szondi Test 

Thematic Apperception Test 
"Tomkins-Horn Picture Arrangement Test 


Adult questionnaires 


Anxiety Scale Questionnaire 
Bernreuter Personality Inventory 
California Psychological Inventory 
Dynamic Personality Inventory 
Edwards Personal Preference Schedule 
Edwards Social Desirability Scale. 
Eight-Parallel-Form Anxiety Battery 
Eysenck Personality Inventory 
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Eysenck-Withers Personality Inventory 
Guilford-Zimmerman Temperament Survey 
Hostility and Direction of Hostility Questionnaire 
Hysteroid-Obsessoid Questionnaire 

> Manifest Anxiety Scale 
Marlowe-Crowne Social Desirability Scale 
Maudsley Personality Inventory 
Minnesota Multiphasic Personality Inventory 5 
Motivation Analysis Test NU 
Neuroticism Scale Questionnaire 
Sixteen Personality Factor Questionnaire 
Willoughby Personality Schedule 


Adult other 


Q sort 

Repertory Grid 
Semantic Differential 
Word Association 


Children projective 


Blacky Pictures 

Children's Apperception Test 

Controlled Projection for Children 

i Pickford Projective Pictures 
World Test 


Children questionnaires 


` Children's Personality Questionnaire 
High School Personality Questionnaire i 
Junior Eysenck Personality Questionnaire 


Children other 


Family Relations Indicator 
j Family Relations Test 


Social Maturity 
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Progress Assessment Chart 
Vineland Social Maturity Scale 


Symptom Rating Scales and Check Lists 


Beck's Depression Inventory 

Bristol Social Adjustment Guides 

Cornell Index 

Elgin Prognostic Scale 

Hamilton's Depression Inventory 

Hospital Adjustment Scale 

In-patient Multi-dimensional Psychiatric Scale 
Mooney Problem Check List 
Multi-dimensional Scale for Rating Psychiatric Patients 
Psychotic Reaction Profile 

Shapiro's Personal Questionnaire 

Symptom Sign Inventory 

Tavistock Self-Assessment Inventory 
Wittenborn Psychiatric Rating Scales 


Vocational Interests 


Guilford-Zimmerman Interest Inventory 
Kuder Preference Record 

Strong Vocational Interest Blank 

Study of Values 

"Thurstone Interest Schedule 


Physiological Tests 


Blood pressure 

Body temperature 
Electroencephalography 
Electro-myography 
Eye movement 

Heart rate 
Plethysmography 
Pupillography 
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Respiration 
Sedation threshold 
Skin potential 
Skin resistance 


Miscellaneous 


Harris Tests of Lateral Dominance 
"Ishihara Test for Colour Blindness 
Level of Aspiration 


Objective-Analytic Personality Test Batteries 
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